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ABSTRACT 


snatial liqht modulators (SLMs) are being used in 

correlation-based optioal pattern recognition ^e»» 

?bese C filters. Therefore it i. necessa „ , to incorporate the 
SLM constraints in the design of the filters. 

The design of a 

annealing -based 6 optimization ^chnigue was investigatede^he 

constraints 1 **The W perPoPPaPce Z pf the fUter was evaluated. in 
of its recognition (discrimination) capabilities using 
computer simulations. The correlation plane characteristics i o 
the SLM-MACE filter were found to be reasonab y goo . 
mace filter yielded far better results than the analytical 
mcl filler implemented on practical SLMs using the 
constrained magnitude technique. 

preset' 

computation" time required for the synthesis of the SLM-MACE 
filter. 
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CHAPTER 1 


Introduction 

During the past two decades, there has been considerable 
growth of interest in problems of pattern recognition and 
image processing. Applications in this area include character 
recognition, remote sensing, image compression, image 

enhancement (for example, in medical diagnosis), speech 
recognition, archaeology, industrial automation (machine part 
recognition, automatic inspection), and target tracking 
systems (1). These expanding applications and the advent of 
high speed digital computers with increased storage 

capabilities have further fueled research into the area of 
pattern recognition. 

There are many digital electronic pattern recognition 
systems which often involve non-real-time operations. However, 
many military and space applications such as missile guidance, 
vehicle tracking, and automated lander guidance in aerospace 
missions involve certain real-time operations. Optical pattern 
recognition (OPR) offers an attractive solution for such 
applications because of its inherent parallel processing and 
high-speed operation capabilities (2). Several signal 

processing operations such as Fourier transform (FT), 
convolution, correlation, and spectral analysis can be carried 
out more efficiently using optical techniques than with their 
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electronic counterparts ,3,. optical data processing therefore 
represents an attractive alternative for potential comme- 
applications such as robotics, automated product rnspec 
end other civiiian fields. In the next section, 
overview of the OPR techniques will be given. 

•) 3 rnrrelatiq n.-Based_OEticai 

pattern p of-ognition 

. nntical pattern recognition are 

Two basic approaches to optic P 

optical feature extraction (OFE) , and optical correlation, n 

case of OFE, certain geometrical properties of the i P 

it . edqes) are computed. The results are 
object (for example, its edges) 

a (usually by a digital computer) for 
subsequently processed (us Y dis cri»inant 

Classification, employing certain preselecte 
functions. In the optical correlation approach a flit 
synthesized from the image of the reference ob 3 ect to 
identified. The input image to be tested for the presence^ 

the desired object is correlated with the filter func . 

a. nr0 ss-correlation value is compared to 
maximum resultant desire<J obje ct 

preselected threshold value to determin 

IS present in the input image scene. The location 

correlation peaK determines the position of the desired o )ec 

1„ the input image. Basic optical correlators do not prov e 

invariance to distortions in the input image, for example 

plane rotations. Hence. to achieve general distortion 

invariance, advanced techniques such as synthetic discriminant 

• j nf hpr methods are used [ ^ 1 * 

functions and other muiw 
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The correlation operation may be Interpreted as a measure 
of similarity between two functions (for example, two images), 
and a similarity measure is the basis for any recognition 
process. In 1961, Vender Lugt proposed a hologram-based 
technique for constructing a matched spatial filter (MSF) . 
With this technique, it became possible to construct arbitrary 
complex matched filters to detect a signal in a noisy 
background by optical means. The MSF when used in a frequency 
plane optical correlator forms an optical pattern recognition 
system. The most common type of such a system is illustrated 

by Figure 1.1. 

An input scene at plane P, denoted by f,(x,yt is 

illuminated by laser light to form a diffraction pattern. This 
pattern is focussed by a lens L, on plane P, . The lens L, 

produces the spatial Fourier transform of f,(x,y) , denoted by 
F 1 (u, v) , i.e. 


f.(u.v) = (x, y)\ • 


fi.l) 


The MSF denoted by H(u,v) is derived from a 
f 2 (x,y) and is placed at the focal plane P 2 

the conjugate of the Fourier transform 
pattern, i.e. 


reference pattern 
. it is basically 
of the reference 


H(u.v) = F 2 * (u, v) . 


( 1 . 2 ) 





5 


where 

F 2 (u, v) = y(f 2 (x,y)), (1-3) 

and * denotes the conjugate operation. The incoming pattern of 
light from P 1 is diffracted by the MSF , thereby producing a 

second diffraction pattern. This resultant pattern on P 2 is 
the product of the transforms F 1 (u,v) and H(u,v) . Finally, the 
lens L3 produces the inverse Fourier transform of this 
product , which is the correlation function. It can be written 
mathematically as 

9 {f\{x,y) ®f 2 (x,y) }= F 1 (u,v) .H(u,v) (1.4) 

= Fj(u,v) .F 2 *(u,v) , ( 1 * 5 ) 


and 

f 1 (x,y)®/ 2 (*,y)=jjf 1 (x / ,y' ) f^x' -x,y' -y)dx' dy' , 

( 1 . 6 ) 

where ® denotes the correlation operation. If the input and 
reference patterns are identical, then the operation is called 


autocorrelation . 
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Thus 

jr <fj(x,y)®/i(*-.y) )- |Fi< u > v > I 2 ' (1 ' 7) 

The correlation function of Eq. (1.6) is obtained at the 
output plane P,. As mentioned earlier, the correlation peak 

value is used to determine if the input image f ,U.y> is 

indeed the desired image to be recognized. 

optical systems (such as the one described above) which 
use the Fourier transform property of a lens offer certain 
unique advantages over electronic systems. The inherent two- 
dimensional nature of an optical system permits it to accept 
large two-dimensional arrays of data from a camera, slide, or 
transparency very easily. A second advantage enjoyed by an 
optical system is its capability for parallel computation, 
that is, all the data points of an image pass through the 
optical system simultaneously, i.e., in parallel. A third 
advantage of an optical system is its ability to operate at 
tremendous data rates, since the signal travelling through a 
passive optical system propagates at the speed of light, its 
throughput is enormous. Finally, a fourth advantage of an 
optical system is that the Fourier transform is relatively 
simple to perform. Thus with the FT as the basic building 
block, it is straightforward to design systems to perform 
correlation, convolution, matched filtering, etc. (5). 
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It is apparent, however, that there are certain ta 

needed of a pattern recognition system t h at are aiificuit or 

^ m hv a purely optical system. One problem 
impossible to perform by a pure y 

a. . themselves cannot be used to 
is that Simple optical systems by themsel 

loct tvpe of decision task might be 
make decisions. The simplest type 

comparison of the output of an optical system with a .to 
value, and this cannot be performed presently without help 
from electronics. Thus, purely optical systems can be designe 
to perform specific tasks (analogous to a "hard wire 

a- s hut are not flexible like a programmable 
electronic computer) , . 

general purpose digital electronic computer. The idea o 
combining digital electronic computer technology with optica 

•♦-o naturally, as a means a PPiy in 9 
systems thus follows quite natural y, 

the advantage of optics to a wider range of problems. The 
systems are called hybrid, since they are composed of bo 

optical and electronic subsystems. 

•) 2 Motivat ion for the Study 

Since the introduction of the frequency plane correlator 

by vender Lugt. matched spatial filters (MSFs, have become 

popular in optical pattern recognition systems. These MSFs 

yield the highest possible signal-to-noise ratio (SHF, when 

detecting a known signal (image, corrupted by additive white 

r- M^FS do not produce sharp peaks and they 
noise [6]. However, MSFs do noc y 

. ■ a- a-h*t is the ratio of the output light 

are light-inefficient, that is, 

to input light power is only about 44 percent (7,. Further 
MSFs are complex in nature; hence, their use in optica 
correlators requires the representation of both the magnitude 
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and phase of the filter function. Also, MSFs are sensitive to 
distortions in the input test images. 

High speed interface devices known as spatial light 
modulators (SLMs) are being developed to replace the film 
transparencies that have been traditionally used as input 
images and as MSFs in conventional optical correlators. 
However, several SLMs of current interest can function only in 
a phase-most ly mode, and thus cannot accommodate the complex 
nature of the MSFs. 

The concept of MSFs has been extended in recent years to 
several types of distortion-invariant filters. The minimum 
average correlation energy (MACE) (8] filter is one of them. 
This filter attempts to minimize the sidelobe levels in the 
entire correlation plane, while still allowing control of the 
user-specified correlation peak value at the origin. Thus the 
MACE filter produces sharp correlation peaks facilitating easy 
detection in the correlation plane. In the MACE filter design, 
training images are used which are sufficiently representative 
of all the expected distortions (that is, 3-D distortions) . 
This is to reduce the filter sensitivity to the distortions. 
The MACE filter will be discussed in greater detail in Chapter 
2 . 

As mentioned earlier, SLMs are used in optical 
correlators at the input and filter planes. The various SLMs, 
constructed on different media, have different constraints on 
what is physically achievable in that medium. Since the SLM 
medium is used to construct the filter in the Fourier domain 
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of an optical processor, these physical constraints will also 
he imposed on the filter in the Fourier domain Since the 
physical characteristics of an SLM are not taken into account 
in the design of the above mentioned MACE filter, they specify 
arbitrary complex values, and hence they cannot be implemented 

on currently available SLMs. 

In References (») and (10). correlation filters have been 

suggested that incorporate the physical characteristics of a 
given s» in their design. Ouday (9) has developed a set of 
necessary conditions for optimising an optical correlation 
filter constrained by an amplitude-phase coupled SLM. Earn and 
Goodman (10) have demonstrated a technigue for an optimal 
filter given an arbitrary region of realizability, 
maximizes the output correlation peak and they have presented 
a fast algorithm for the design. However, these SLM 
constrained filters do not take into account possible 
distortions in the input images and therefore, there is a need 
for the development of distortion-invariant filters which are 
constrained to the region of realizability of the physical 
characteristics of a given S». m Reference (1), a real- 
valued MACE filter was developed for implementation using 
real-valued SLMs . However, until very recently, no composite 
filters had been developed, which could accommodate an 

arbitrarily constrained SLM. 

it. objectives 

J„ order to overcome the difficulties mentioned above, 
the principal objective of the research leading to this report 
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. nf , technique to incorporate 
was chosen as the development of a techniq 

• sira of a aiven SLM into a distortion 

the physical characteristics of 9 

. Hon filter design. The type of SLM 
invariant correlation filter 

constraint considered was one in which there existed a cross 
coupling between the amplitude and phase. The MACE filter was 
chosen for optimization, since it minimizes the average energy 
over the correlation plane and maintains the user-speci re 
peak value at the origin. This way the sidelobes in the output 
correlation plane are much smaller than the value at the 
origin. This facilitates easy detection of the correlation 
peak in the entire correlation plane. The simulated annealing 
algorithm was used to perform the minimization of 
correlation energy function for this constrained MACE filter. 

f fh is filter was to be evaluated on input 
The performance of thi 

images with and without background noise. 

id. outline o f the Repor t 

This report is organized as follows. In chapter 2, 
various distortion-invariant pattern recognition filter 
designs from the literature are reviewed. Chapter 2 also 
discusses the characteristics of currently available spatial 
Ught modulators (S«s> . and some filter optimization 
techniques under the constraints of the physical 
characteristics of an SI*. In Chapter 3. the development of 
the SLM constrained distortion-invariant filter is discusse , 

along with the algorithm used for its synthesis. Chapter 4 
presents simulation results used to evaluate the performance 
of this constrained composite filter, along with a discussion 
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of the results. In chapter 5, a summary of results and 
conclusions derived from the study are presented alon, with 
recommendations for future wort. 



CHAPTER 2 


Correlation-Based OPR Filters 

As mentioned in Chapter 1, in the field of correlation- 
based optical pattern recognition systems, matched spatial 
filters are optimal in the sense of maximum signal to noise 
ratio (SNR). However, these filters perform poorly when the 
input test images are subjected to distortions like in-plane 
or out-of-plane rotations. In this chapter, a review of some 
correlation— based distortion— invariant pattern recognition 
filters proposed in the literature is presented. In particular 
the MACE filter design is discussed in detail. 

Recently, spatial light modulators (SLMs) are being used 
to implement filters in the frequency plane of optical 
correlators. Most currently available SLMs cannot encode fully 
the complex-valued frequency response of the optical pattern 
recognition filters that have been proposed by researchers. 
Some filter design techniques proposed in the literature which 
take into account the constraints imposed by the SLMs will be 
reviewed in latter sections of this chapter. 

2.1. Distortion-Invariant Pattern 
Recognition Filters 

Various approaches have been advanced in recent years to 
achieve general distortion invariance in optical pattern 
recognition. Casasent [11] detailed a generalized method which 
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uses . synthetic discriminant Action <SDF> to 
U • correlators. The 

• «♦- ucp for use m optical couc 

distortion-invariant MSF fo 

. _ f al i the training images whic 
SDF is a composite function of ^ lBage . 

are deliberately distorted versions 

. a linear combination of the traim g 
Thus the SDF filter is a linear 

• ^ fro vield user-specified cross 

And it is designed to yiexu 

ima ^ ' • • for all the training images, 

correlation values at the origin equally 

• frhAfr this filter will correlate equally 
The expectation is that th ^ ^ other 

well not only with the training images, 

f the reference image which are wi in 
ai Ported versions of the reietei 

distortea A disadvantage 

- frr-Ainina set images. « ^ 

distortion range of the training 

- - - — - - ■“* r';:: 1 ::.;::;;::, .. 

~~-r - 

cite filters which will minimize the 
was to design composite filter 

side lobe levels in the correlation plane. 

fr a! r 81 proposed the minimum average 
Mahalanobis et al.[8] pr P 

rMACE) filter which results in a sha p 
correlation energy (MACE) f 

v of a specified value at the origin due to th 
correlation peak of a speci 

f the average correlation plane energy, 
minimization of the 9 to re duce the 

the SDF filter, training images 

• , the filter to distortions. In the following, 

sensitivity of the filter r 

the MACE filter design is discussed. 

, • -.coc »<= well as the filters 

Throughout this report, the images as 

„ „ he in the discrete domain. The images and 

are assumed to be in 

• fr Of arrays of dimension NxN obtained by 
filters consist of arrays o 

To of continuous signals. However, 
discrete sampling 
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convenience, these arrays are represented by vectors of sire 

dXl <d " NXN) thr ° U9h lex ^ c °graphical ordering of their rows 
Boidface betters are used to denote vectors and matrices, and 
iower case ietters denote scaiar guantities. image and fitter 
sequences are identified by an overbar notation. Uppercase 
symbols refer to the frequency plane terms, while lower case 
symbols represent quantities in the space domain. 

Let the data sequences 5,(0). i . l, 2 ^ represent 

the training image sequences, where is the number of images 
In the training set, and *,<*> denotes the DPT sequence of 

" J(n) ' rePreSent6d aS 3 vector X, of dimension d. The 

matrix x with column vectors X , is denoted by 


1 = [X 1' X 2> 


( 2 . 10 ) 


The vector h represents the filter sequence H(n) i n the space 
domain, and the vector , its DPT »«*, ln the frequency 

aomain. The average correlation plane energy for all the 
N t images is given by 


E * ve = N t £ f ^ ^ { ^ H(k) I" \ x i(U I 2 )] . 


( 2 . 11 ) 
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Now 


, Eq. (2.11) can be wr 


itten in vector-matrix notation as 


E = H'DH, 


( 2 . 12 ) 


whe re the superscript ♦ -notes the connate transpose 
operation. » is a diagonal matrix of size dxd given by 


i £ 

D{k,k) = "tr d 

■» v t a*i 


(2.13) 


Th e MACE filter is designed so as to einibize the average 

correlation energy given by Eg. (*•»>. ^ *"* 

the value of the correlation function at the origin eguals a 
•eied value The constraint at the origin of the 

user-specified value. 

correlation plane can be written as 


?J (0) - i t <«»(*> = u '' 


(2.14) 


where u, is the user-specified constraint value at the origin. 

FO r all the training set images Eg. (2.14) can be written as 

(2.15) 

X* H = u. 

Where » is the N t *l output constraint vector. Thus E. v . in Eg. 

. . . , ciih-iect to the constraints in Eq. (2.15) 

(2.12) is minimized subje 

using the Lagrange's Multiplier method. 
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This leads to the following filter [8] 

JW« * jr ' X<X D 1Z> 


( 2 . 16 ) 


Mthough MACE filters produce sharp correlation peaKs, 

to have two drawbacKs. First of all, there is no 
they appear to have two 

, 'it* into these filters. Secondly, these 
noise tolerance built into 

_ i t ive to non-training images than 

filters seem to be more 

filters (12]. Some modifications to the MACE 
other composite filters i 

to overcome these problems, 
filter have been proposed to overc 

filters more robust against the 
To make the composite filters mo 

casasent and Ravichandran [11] propose 
non-training images, C 

MacF fGMACE) filters where the 
the design of the Gaussian MACE (GMACE) 

output correlation was constrained to be a broad Gaussian, 

rather than a sharp function. Sudarshanan et al.[l«) 

• «-*o mace filter design 

. . ^ f ii4. er wherein the mace, uitci 

a compromise composite filter 

. a._ the requirements of both a g 
was modified to accommodate th q 

*nd a sharp correlation peak output, 
noise performance and a sna p 

o o implementation 

HiTontdcai cW aiatars 

so far in this chapter, some of the composite filters 
designed for distortion-invariant pattern recognition, i-e 
filters which are insensitive to distortions, have be 
discussed. Another important consideration in the 
optical correlation filters is their practical implementation 
using available electro-optical devices. As mentione 
Chapter i, in 1883, Vender bugt [IS] demonstrated a simpl 
hologram-based optical technigue for synthesizing freguency- 
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plane masks for coherent processors. This technique recorded 
a complex filter function on a photographic film with the help 
of an interferometric system [15]. In such a system, coherent 
light having an amplitude transmittance equivalent to the 
desired impulse response of the filter is made incident on a 
lens. The resultant Fourier transform of the impulse response 
is incident on the photographic film which records the complex 
filter function. Lohmann and Paris [16] proposed an easier 
method for constructing complex filters. They suggested using 
a computer-aided plotter to draw the holograms which would be 
used to realize the filters. The holograms would then be 
recorded on a film. This eliminated the rather difficult task 
of optically synthesizing the filter on the photographic film 
as suggested by Vander Lugt. 

Since the introduction of these filter implementation 
techniques, various design algorithms for OPR filters were 
proposed by researchers. However, the above discussed 
techniques for filter implementation were found to be 
unsuitable for certain real-time applications of OPR systems. 
Such applications need the capability wherein the input images 
as well as the reference filters can be changed rapidly. Thus, 
in order to take advantage of the phenomenal processing speed 
of an optical correlator system, high-speed interface devices, 
known as Spatial Light Modulators, were introduced to replace 
the holograms. 



2,2.1. Spatial Light 
Modulators (SLMs) 
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SLMs are the basic building blocks of OPR systems which 
are used to implement the input images and filters. They 
encode the phase and amplitude information of an image or a 
filter onto an incident beam of coherent light as a function 
of space. There are two types of SLMs, one which can be 
addressed electrically and the other that can be optically 
addressed. In the case of the former type, voltage or charge 
is the control signal (for example, the Deformable Mirror 
Device (DMD) ) , while light intensity is the control signal for 
the latter type (for example, the Hughe's Liquid Crystal Light 
Valve (LCLV) ) [17]. 

However, there is a limitation on the currently available 
SLMs with regard to the actual implementation of a filter on 
them. Ideally, an SLM should be able to adjust both phase and 
amplitude as required by a recognition filter. For all 
currently available SLMs, one control signal (either optical 
or electrical) is used to achieve the phase and amplitude 
modulation. Hence, the phase and amplitude cannot be 
controlled independently. In a DMD, the control signal not 
only modulates phase but also changes the amplitude from 
unity, though to a lesser extent, and vice-versa for the LCLV. 
Hence, these are appropriately referred to as phase-most ly 
filters (PMF) and amplitude-mostly filters (AMF) , 
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respectively. This fact will become clear for the case 

PHD, when its practical operation is discussed in the next 

section . 

3.2.2. The Deformable M irror 
novice (DMD) SLfJ 

Figure 2.1, reproduced from [18), shows a cutaway view of 
a section of the deferrable mirror device SLM. The DMD is 
composed of an array of 128 x 128 pixel elements with each 
element consisting of four reflective rectangular flaps hinged 
on the corners. These are known as cantilever-beam deformable 
mirrors. The flaps are drawn downward by an electrostatic 
charge maintained on the electrode under the surface of each 
pixel element [ 18 ). It is this mirror deflection that is used 
to modulate light [19). Since each of the flaps is about 0.5 
mil square, a deflection of about one degree will cause the 
inner tip of the flap to displace through < radians of phase 
using laser light (Wavelength - 632.8 nm) [19). Thus, the DMD 
is primarily a spatial phase-modulator that permits the phase 
at a given pixel element to be controlled over a continuous 
phase range through an electrical control signal. Since the 
pixel flaps move through a range of angles to the DMD surface, 
there is some additional amplitude modulation of the light due 
to the signal deflection. 
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Figure 2.1. Cutaway View of a Section of the 

Deformable Mirror Device (DMD) SLM [13] 
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SU,s form an integral part of optica! corrector systems 
today. ror an optica! corre!ator to be ,enera!!y useful. the 
input plane SLM must operate in real-time. In fact for mos 

faster rate. This is especially true if a large numher of 
enters need to he changed at a rapid rate, hefore a 
correlation is detected. The DMD is faster than most SLMs, an 
exceeds the speeds of common liquid crystal displays 120). 
Hence, the DMD is a suitable SLM for use in an optical pattern 
recognition system. In the next subsection, 

designs which accommodate the modulating characteristics o 

available SLMs are discussed briefly. 

2 2 3 rnrre 1aHnn ~ Base ^ 
piuprs fo r SLMs 

Since the time Vender Lugt introduced the matched spatial 
filter, various filter designs were proposed by researchers. 

Hi mussed in Section 2.1 of this chapter. 
Some of these were discussed m a 

use of continuous amplitude- 
All these methods presuppose the use or co 

phase filters in the realized optical correlator. However, as 

discussed in the last two subsections, programmable. 

continuous amplitude-phase SLMs do not exist to date. Hence, 

the utility Of these filter designs in practical correlators 

is severely limited. On the other hand, programmable SUis 

limited to quantized levels of amplitude or phase are 

presently available. In anticipation of the availability of 

models of the SLMs like the DMD, and filters 
these devices, models or cne 

. ■, iL-mp SLMs were developed by 

that could be synthesized on these SLMs w 
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researchers. The modifications of the classical MSF to get the 
phase-only filter (POP) [2D and the binary phase-only filter 
(BPOF) are among the most important, since they are easy to 
implement on available SLMs such as the Magneto-Optic SLM. 

The POF is identical to the MSF, except that its 
magnitude is set to unity for all frequencies. In POFs, since 
the amplitude transmittances are set to be constant, the 
continuous phase is used to synthesize the filters on existing 
phase-modulating SLMs . BPOFs are a simplified version of the 
POFs. Here, the continuous phases of the POF are quantized 
into two phase levels. The pixels in a BPOF take a value of ♦! 


or -1 depending upon their respective phase angles. Generally 
the POF and BPOF have to be implemented on a phase-modulating 
SLM. Several researchers have reported methods for optimizing 


the conventional POFs and BPOFs based on various performance 
measures. Some of these are discussed in the next subsection. 
3.2.4. Filter O ptimization 
Techniques 

Vijayakumar and Bahri [6] investigated theoretically the 
optimality of the conventional POF. They proved that with 
proper selection of the filter passband the conventional POF 
yields the highest signal to noise ratio (SNR) among 
filters. The resulting filter (with the corresponding filter 
passband) is termed the Optimal POF (OPOF) . This concept of 
optimizing an optical correlation filter constrained to a 
particular SLM has proven to be an important subject for 
research with the anticipated availability of SLMs with 
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different operating characteristics. Accordingly, much work 
has been devoted to this subject recently. Downie and Reid 
[22] studied the optimization of BPOFs to obtain optimal peak- 
correlation response and peak to sidelobe ratio. Recently, 
Downie [23] investigated the design of BPOFs that maximize 
some other filter performance criteria like SNR and their 
ability to discriminate desired objects from the undesired 
ones. 

The design and simulations of the phase-encoded and 
binary phase-encoded filters and their optimization by the 
various researchers were based on the phase-only property of 
the SLMs. They did not take into account the "phase-mostly" 
nature of these devices, which actually modulate the amplitude 
in addition to the phase as observed in Section 2.2.1 of this 
chapter. Thus, some other filter optimization techniques were 
proposed which did precisely that. But, as seen above, the 
designs of an optimal filter were considered only in special 
cases (e.g., BPOF design) [6,22-23]. Therefore, there is a 
need to design an optimal filter, given a general 
realizability constraint for an SLM. 

2.2.5. Filter Optimization for 
Cross-Coupled ST.Ms 

Ideally, an SLM should adjust both phase and amplitude 
independently. However, as observed for the DMD in Section 
2.2.2 the single control parameter, namely, the voltage, 
modulates the phase and amplitude simultaneously. This is 
known as the cross coupling between phase and amplitude. The 
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actual cross coupling between the phase and amplitude may be 
adjusted during the manufacture of the device. But, given that 
the SLM is controlled through a single parameter (electrical 
signal in the case of the DMD) , one cannot achieve any 
arbitrary combination of phase and amplitude. Rather, the 
relationship between the phase and amplitude is fixed for all 
the pixel elements, for a given SLM. The challenge is to 
obtain an optimal filter within the constraints of the one- 
parameter combination of phase and amplitude for each pixel 
value of the filter. 

Juday et al.[18] showed a simulation of optimizing an 
amplitude-phase cross-coupled filter by a brute force 
relaxation method of Juday and Daiuto [24). They considered 
the variation of the SLM phase to be quadratic in logarithm of 
the amplitude. Figure 2.2, reproduced from [18], shows this 
relationship between the phase and amplitude. As the 
electrical signal S varies, the response of the DMD is 
constrained to move along the curve. To start with, a POF is 
computed and applied to the filter DMD. The amplitude and 
phase values for the (m,n)th element of the conventional 
matched filter (MF) is represented by the point MF(m,n) . A POF 
device response would correspond to the point POF(m,n). 
However, the needed filter pixel values are constrained to lie 
only on the curve. Retaining the phase value of the POF for 
this (m,n)th pixel under the operating constraint, the actual 
response to the calculated filter occurs at position CMF 0 (m,n) 
( in Figure 2.2). 
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The filter optimization is continued by varying the 
values of the filter DMD, pixel by pixel, until a maximum 
correlation is observed. After all the pixel values have been 
adjusted, the correlation function value of the filter is 
compared to that of the last filter. The procedure is 
terminated when this difference is less than some 
predetermined value. Thus, the starting filter is CMF 0 , and it 
is relaxed to the optimal final filter CMF f . The details of 
this algorithm are given in Reference [24]. The computation 
needed for this method is considerable. Juday [9] has proposed 
another analytical technique to solve this same filter 
optimization using the method of calculus of variations. This 
new method considerably improves on the relaxation algorithm 
discussed above, by reducing the amount of computation needed. 

The filter synthesized using the above technique is 
optimal in the sense of obtaining the maximal correlation 
peak. However, it does not minimize the correlation plane 
energy to yield low sidelobe levels as in the case of the MACE 
filter. One of the objectives of the research presented m 
this report was to do precisely that. 

2.2.6. Correlation Filters for 
AT-hi trarilv Constrained 
Devices 

Farn and Goodman [10] have proposed a theory for the 
optimal design of a correlation filter, given any arbitrary 
realizability constraint. The filter is optimal in the sense 
of maximizing the intensity at the output correlation peak. 
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The constraint depends upon the physical modulating 
characteristics of a given SLM. They have also proposed a fast 
algorithm to design the filter. The SLM constraints for the 
filter could be phase-only modulation, binary phase-only 
modulation, or amplitude-phase cross coupling. 

This technique and the one discussed in the previous 
section represent the first attempts at optimizing a filter, 
given any general constraints for the operation of an SLM. 
However, all the optimization techniques for constrained 
filters discussed so far are intended for the recognition of 
a single image. There have been some attempts aimed at 
designing distortion-invariant correlation filters which are 
suitable for implementation on available SLMs and they are 
discussed in the following section. 

2 a 2 « 7 . Distortion-Invariant 
Correlation Filters 
for SLMs 

As mentioned before, all the composite filter designs 
discussed at the beginning of this chapter have assumed the 
availability of programmable, continuous complex valued SLMs. 
In reality, this is not true. Hence, the focus of research has 
shifted to developing distortion-invariant filters for optical 
correlators that are capable of being implemented on SLMs with 

limited modulation capabilities. 

7 . 1 . .grtF-POFs and SDF-BPOFs . Horner and Gianino [25] 

applied the phase-only concept to a conventional SDF. 
Basically, they computed an SDF similar to the one proposed by 
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Casasent [11], and derived its PDF version by setting the 
magnitude to unity tor all frequencies. This is known as the 
SDF-POF. They also developed a simplified version of the SDF- 
POF using biphase quantitation. Here, the phase values of the 
SDF-POF are quantised to just two values depending upon their 
original phase values. This approach is similar to that of 
designing a BPOF, and is referred to as an SDF-BPOF [25]. 
However, design of the SDF-POFs. and BPOFs using this 
technique is incorrect because the filter modulation operator 
(for example. PDF or BPOF) is applied to a conventional SDF 
filter after it is synthesized. This will change the 
information content contributed to the filter from each 
training image. Hence the correlation of such a filter with 
each training image will not give the specified peak at the 


origin. 

Kallman (26) has suggested a method of directly 
constructing distortion-invariant phase-only filters by 
optimizing the peak-to-sidelobe ratio for a set of training 
images. Although this method yields filters with desirable 
qualities, the technique is computationally intensive, and 
yields little information about the theory of distortion 
invariant filter construction [27). Also, it does not provide 
a specified correlation peak for each training image. 

0079 . comeosite filte rs constrained to SLM modulatin g 
.h.raptpri sties . Jared and Ennis [27) have considered a 
modification to the conventional SDF by including the filter 
modulation (due to the SLM) in the synthesis process. They 
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different from the above in the optimization method used. 
Also, here the average correlation plane energy was sought to 
be minimized while maintaining the user-specified values at 
the origin of the output correlation plane. 

2.3. Summary 

This chapter focussed attention on two important areas of 
filter design techniques for optical pattern recognition. One 
of them is the development of correlation-based distortion- 
invariant filters, and the other is the implementation of 
these filters on currently available spatial light modulators. 
In this report, the development of a composite filter for 
implementation on an arbitrarily constrained SLM is studied. 
In the following chapter, the optimization algorithm used to 
synthesize this filter is discussed in detail. 



CHAPTER 3 


SLM-Constrained MACE Filter 

A number of filter design techniques that have been 
proposed to achieve distortion-invariant pattern recognition 
were reviewed in Chapter 2. The minimum average correlation 
energy (MACE) filter is one such filter which produces a sharp 
correlation peak in the output facilitating easy detection. 
The MACE filter produces higher peak-to-sidelobe ratios than 
the SDF filters. Hence, in this report the design of MACE 
filters is considered. The need for an SLM-constrained MACE 
filter is first discussed and then an algorithm for its 
synthesis is presented. 

3.1. The Need for an SLM-Constrained 
MACE Filter 

As mentioned in Chapter 2, SLMs are used in OPR systems 
to implement the filters. Whereas a designed filter may have 
arbitrary complex values, the SLM, as noted earlier, can 
accommodate only a constrained set of values. If the 
correlation-based OPR filters are to be implemented on such 
SLMs, then the modulation characteristics of SLMs must be 
included in their design. 

One such SLM, namely, the DMD, has good potential for use 
in OPR systems due to its advantages over other SLMs as 
discussed in the previous chapter. Hence, there is a need to 
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develop filters which can be implemented on the DMD. Most of 
the SLM-constrained filter designs proposed in the literature 
do not take into account distortions in the input images. Some 
of these designs were discussed in Sections 2. 2. 4-2. 2. 7 of 
Chapter 2 . 

As discussed in Chapter 2, the MACE filter is attractive 
for use in Optical Correlators since it minimizes the average 
correlation energy over the output correlation plane, while at 
the same time maintaining the user-specified sharp correlation 
peak. It is proposed in this report to apply the MACE design 
concept to develop a method to design a SLM-constrained 
distortion-invariant filter. This SLM-constrained MACE filter 
can be implemented on a DMD with its phase— magnitude 
constraints . 

3.2. Development of the SLM-Co nstrained 
MACE Filter 

The problem at hand can be stated as follows. It is 
required to design a composite filter which will incorporate 
the possible distortions (for example, in-plane rotations) in 
the input test images, and at the same time the filter pixels 
are constrained to take on values which obey the physical 
characteristics of a given SLM. The SLM-constrained MACE 
filter is such that the correlation function levels are 
minimized at all the points in the output plane except at the 
origin where the response must have a user-specified value. Of 
course the operating characteristics of the SLM should be 
available beforehand. 



33 


The required composite filter is synthesized from a set 
of training images which represent the distorted versions of 
the reference image. The SLM-constrained MACE filter, like the 
original MACE filter, is synthesized in the discrete frequency 

domain. The column vectors X i and H denote the 1 th training 

image and filter, respectively, in the frequency domain. The 
matrix X is formed by arranging all the training image vectors 
X 1 , i = l,2, ,N t , as columns of that matrix, where N c 

denotes the number of images in the training set. The training 
image vectors X i and filter vector H are of dimension d 

(equal to the number of pixels in the reference image, namely, 
NxN) . Minimization of the correlation function values at all 
the points in the output plane can be achieved by minimizing 
the average correlation plane energy, which is given by 

= H'DH, (3-D 


where + denotes the conjugate transpose operation. The 
diagonal matrix D is given by 


D = 


N c i-i 


(3.2) 


where 


D i (k,k) 


|*i<*> I 2 


d 


(3.3) 
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While minimizing Eq. (3.1), the correlation function 
value at the origin for each of the training images is to be 
maintained at a user specified value. This will facilitate 
easy detection of the peak value at the origin in the output 
plane. The correlation peak constraint for the i th training 
image is given by 

*4<o> --gX/jr-u,, (3 * 4) 


where u i is the user-specified peak value for the i th training 
image. 

Next, the constraints imposed by the modulating 
properties of a given SLM need to be incorporated in the 
design of the filter. In a single-parameter SLM like the DMD, 
the phase and magnitude at a given pixel element are 
controlled by the excitation voltage applied at that pixel 
element. In such a case, there is no independent control over 
the phase and magnitude of the filter pixels. This is known as 
the phase-magnitude cross coupling for a given SLM, and is 
dependent on the manufacturing process of the device. The 
experimental data corresponding to the physical 
characteristics of the DMD is available in the form of a table 
with two columns. The entries in the first column of the table 
correspond to the phase values which represent the phase 
modulating capabilities of the SLM. The entries in the second 
column give the respective magnitude values for each phase 
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value. This table ll.it. the complex pixel values that the 
required filter can acquire so that it can be indented on 

a given SLM* 

Thus, the filter design problem can be viewed as a 
constrained optimisation problem and can be summarized as 
follows. The aim is to determine an optimal filter by 
selecting its pixel values from among the phase-magnitude 
value pairs given by a table such that the correlation plane 

1 - r. n 11 is minimized subject to the peak- 

energy given by Eqn. (3.1) is minimx^ 

~ i?rvr» 4 \ Thus Eqn. (3.1) is the 

value constraints of Eqn. (3.4). 

latter part of the problem, 
objective function here. The 1 P 

namely, minimizing Eqn. (3.1) subject to the constraints of 
Eqn . ,3.4) can be modified into a new single obgective 
function. This can be done by including in the new obgective 
function some penalty for violating the constraints. 

The correlation peak constraints of Eqn. (3.4) can be 


written as 


Ui 

Iw(X/H}= 0. 


(3.5) 


Using Eqns . (3.1) 


. 1 ) and ( 3 . 5 ) , the new objective function can be 


written as 




- a-DB ♦ * k 2 g (Im(EVHl) 


(3.6) 
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„ i-x are used to introduce 

Here, the constraints of Eqn. < • > ive 

intn the original objective 
quadratic penalty functions into 

fUnC r E q. (3.6, the K u 's and Kj are some positive constants 

greater than 1. The vaiues for these constants will depend 

upon the specified constraint values u, . For example. 

_ i,u D n values for the 
two-class pattern recognition problem, 

of the two classes will be different, 
training images of 

fhp K / s will be different for 
Therefore the weightage for the K u 

t „ , s The ratio between the K u ’s should be the 
the different u* ' s. me 

same as the ratio between the corresponding V- Thus, the 

_ „ n n subject to the constraints of 

problem of minimizing Eqn. (3. ) 

F a problem of minimizing a 

P (3 5) is reformulated into a p 

Eqn. (J.o; n 

single objective function with the constraints ^ 

k- fhat obiective function. Now the require 
included within that obgecri 

optimal filter If can be determined such that Eqn. • > 

minimized under the constraints of the - ^latin 

_ 4- imi zation is commenced with small 

characteristics. The optimization 

. Arir i i s continued with 

values for the penalty constan 

gradually increasing values such that the constraints are no 
violated and the objective function converges to a mini™ . 
The filter thus obtained is the ^-constrained MACE - 

The system variables in this optimization are the filter pixe 


values . 



37 


It is expected that the correlation function of this 
filter with the training and non-training set images 
evaluated at the origin will give values which are close to 
the user-specified values at the origin. Of course, the non- 
training images should be within the distortion range of the 
training set images. The sidelobes in the correlation plane 
are also expected to be minimized so that the values at the 
origin will correspond to a peak and can be easily detected. 
3.2.1. Optimization 
Techniques 

Several optimization techniques are available in the 
literature and the choice of a particular algorithm would 
depend upon the nature of the problem to be solved. 
Optimization problems can be broadly divided into two 
categories: those with continuous variables, and those with 

discrete variables. The optimization problem at hand as 
discussed in Section 3.2 basically falls into the second 
category. However, the SLM constraints given by the phase- 
magnitude data could be approximated by a mathematical 
equation. The constraint equation so formed could be included 
in the objective function of Eqn. (3.6) using the penalty 
function technique. The entire problem could then be viewed as 
an unconstrained minimization problem and it could solved 
using the algorithms from the first category some of which 
will be discussed here. 

Methods of finding the minimum of a function of 
continuous variables generally involve the evaluation of the 


38 


4 -hoit- first partial derivatives, and 
function values, their 

A nsrtial derivatives as well. Optimization 
sometimes the second partial aer 

techniques which mate use of partial derivatives are Known as 
gradient methods. The method of steepest descent is one such 
gradient technique. This method starts by choosing arbitrary 
values for the function variables. New values for the 
variables are determined by evaluating the first derivative of 
the function at their present values. This procedure is 
continued until the derivative becomes zero or close to it. A 
local minimum of the function is said to be reached at those 

values of “the variables. 

The conjugate-gradient method of minimization is an 
advanced form of the steepest descent method. The Fletcher- 
Powell [ 31 ] version of the variable-metric algorithm is an 
improved form of the conjugate gradient technique to minimize 
a quadratic function with no more than n steps (where n is the 
number of variables in the function) . There is no scope for 
discussion of the details of this algorithm here. Basically it 

is a rapidly converging descent method. 

It is important to note here that all these methods 

require calculation of the first derivative of the function. 
Hence they are not suitable for solving the optimization 
problem discussed in section 3.2. First of all, analytical 
calculation of the first derivative of the function is 
impossible here; hence, a numerical technique would have to be 
used. NOW, the number of variables involved here are very 
large. For a 128x128 size image, the total number of variables 
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are 16384. Using a numerical technique to determine the £l 

derivative would be very time-consuming. Also, the gra 

do not perform very well when there are boundary 
techniques do not p . the 

• ■ verified for the function variables. This is 

conditions specified valU es 

At hand because the tirce* f 
case for the problem at hana o 

have to be within the given tabular data. 

. cateqory of minimization techniques, 
Now the second category 

• ui 0 q seen to be noire 
namely, those involving discrete^ v«ia - 

applicable to the problem at hand. Se ^ ^ 

methods for multi-dimensional mimmizati 
he literature. These methods attempt to determine a globa 
minimum of the objective function by evaluating it at sever 
points rather than by calculating first der ^ 

airect-search technique which has been oun 

particularly effective in certain applications is that of 

^ Pattern Search technique. 

~ noi known as the patxem 
Hnokes and Jeeves [32], Known 

However, its effectiveness has not been evaluated for the case 

Of a very large number of variables. 

There is another category of optimization problems Known 

as combinatorial optimization. These could be generally 
classified as belonging to the second category, namely. 
o£ discrete variables. Combinatorial optimization involves 

problems of finding the optimum of an objective func 

defined on a limited solution space. With this 

problem discussed in Section 3.2 does seem to ave 

similarities to a combinatorial optimization problem, his , 

■ *- i Hat-a corresponding to the 

the experimental data corr f 


because 
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characteristics does constitute the United solution space 
available to solve the minimization problem ot Eqn. (3.6). An 
optimization technique known as simulated annealing (SA) was 
proposed by Kirkpatrick et al.[33] to solve combinatorial 
optimization problems. It is discussed in detail in the next 
section along with its applicability to the problem at hand. 
3.2.2- Solving the Optimization 
Pr-ohlp.m bv Simulated Anneal ing 

The simulated annealing technique is a comparatively new 
method and has been used in the recent past for solving 
complex optimization problems. It is a form of stochastic 
optimization, and is reported to perform well for problems 
involving a large number of variables in applications such as 
the design of computers [33], image processing [34], and 
encoding of a binary phase filter [35]. It is easy to adapt 
the SA technique to the problem at hand, namely one in which 
there is a limited solution space. This refers to the 
magnitude-phase constraints of the SLM. Also, the number of 
variables involved in this problem, i.e., the filter pixels, 
is very large. These factors lead to choosing the SA technique 
to solve the SLM-constrained MACE filter optimization problem. 

The idea of simulated annealing originated from the 
metallurgical annealing process in a physical system. The 
metallurgical annealing process is a thermal process for 
obtaining low energy states of a system. The aim here is to 
determine the state of global minimum energy of the system. 
This is what the physicists call the ground state. The ground 



41 


. , si ow cooling of the system from » h^h 

state is reache ^ cooUn g schedule must be 

temperature to -st be slow enough so that the 

controlled appropriately me tastable 

„ Mt trapped in thermodynamically 
system does no g . the system, conversely, 

. ,rp the local minima of th y 
states. These a v> , on it will take an 

, M is cooled too slowly then it 
if the system is . 

. . . to reach the ground state. 

unnecessarily long achieved by 

, c^tes of the system can oe 
The lower energy states ^ This 

using an algorithm propo com puting the 

- °zz' — - • - - 

equilibrium distnb ^ step „ f this algorithm, a 

particles in a heat ^ ^ ^ disp lacement and the 

particle is given AE is computed. The new 

resulting change in the sy , if the 

- fhP svstem is accepted if _ 

energy state o state of lower energy. If 

displacement brings the system to a state 

State is accepted with probability 
AE > 0 , the new state is 


P(A E) = 




fant and t is the temperature of 

v i <= the Boltzmann cons 

where k is th =tate is accepted 

4- rt a hiaher energy stare 
, . * a ttiov© to & ni.yi 

the heat bath. the consequence 

in a limited way. Th distribution after 

that the system approx properly desc ribes the 

several itera 1 given T. This basic 

state of thermodynamic equilibrium for gi 



42 


step is repeated many times until the system reaches its 
ground state. Kirkpatrick et al.[33] linked the annealing of 
physical systems with combinatorial optimization and called it 
simulated annealing. 

the SA technique is used to find the global minimum 
of an objective function, the probability of being trapped in 
local minima can be made very small. This is possible because 
in addition to accepting transitions leading to a decrease in 
function value, increases in the function value are also 
accepted in a limited way. This makes it possible to climb out 

of a local minimum of the function and approach the global 
minimum. 

The objective function that is sought to be minimized 
using the SA technique is given by Eqn. (3.6). The system 
variables to be determined in this optimization problem are 
the pixel values for the filter H. The number of variables is 
given by d=NxN, which is the size of the reference image, 
hence, of the filter too. 

Thus the minimization of an objective function using the 
SA technique can be achieved by reducing a temperature 
parameter from an initially high value to a low value, and 
perturbing the system variables as the temperature changes. 
Let the energy to be minimized (given by Eqn. (3.6)) be 
E(v i ] ' -i = 1 / 2 , . . . , d, where the v^'s are the function 
variables to be determined. 

The optimization is initiated by starting with a random 
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, f v and calculating the energy BlvJ . Here, 

configuration of v 1 , 

, . 1 .^-, filter pixels and are 
the VS are the phase values o£ the 

the chase-magnitude data available in a 

selected from among P ^ of thls chapter, 

tabular form. As mentione SLM _ lt 

the physical constraints o 

this data represents ^ fQr . mt er 

. here that when a phase 

Should be no . ts correspon ding magnitude 

pixel is picked from phase -magnitude 

ls a iso chosen to accommodate the P 

. tlcs o£ the SLM. The phase-magnitude pairs 

coupling characteristics of the 

-r 

out. Each Of the system variables v, . 1 

A V ran sed by the random 
„ . . The energy change AF caused y 

randomly perturbed. The energy 

fhe i th variable is calculated as 

perturbation AVj for 


follows 


A F = E nev ~ E old 


(3.8) 


where 


J new 


= E ( Vi° id+ Av 1 ) , 


(3.9) 


and 



( 3 . 10 ) 


The perturbation A v i may be positive or negative and its 
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filter pixels can accept values. 

Now, the phases of the filter pixels are treated as the 
system variables. When the phase of a filter pixel is 
perturbed, the given table is searched for the new phase. The 
corresponding phase- magnitude pair from the table forms the 
complex value for that pixel. If AE>0, then the perturbation 
is accepted, based on the acceptance probability given by 


P(AF) 


1 _ 

1 + exp ( 



(3.11) 


where T is the temperature parameter which includes the 
constant k also. To do this, random numbers uniformly 
distributed in the interval (0,1) are generated. The random 
number is compared with P(AE) . If it is less than P(AE) , the 
perturbed configuration of is accepted, otherwise the 

previous configuration is retained. This is repeated for all 
the d variables. For the perturbed configuration of v i , the 

energy difference A E is computed rather than evaluating the 
entire objective function of Eqn. (3.6). This method of 
calculating and updating the system energy is computationally 
efficient. The probabilistic technique of accepting higher 
energy values avoids the possibility of the system being 
trapped in local minima. 

The temperature control parameter T should be decreased 
gradually at appropriate steps. At each temperature, the 
optimization should continue long enough so that the system 
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, te The method of decreasing the 
reaches a steady s a ■ numbe r of variable 

and determining tn 

temperature. te mperature Is Known as the 

perturbations attested ^ ^ ^ 

annealing schedu e, ^ te „ pe rature was chosen to be 

filter design problem the in . ective function. The 

one-half the initial value of the . T§> 

„ ^ wa s lowered exponentially as T. 

temperature T was ^ 

here T 1® the temperature at the n“ staqe an 

At each temperature, enough perturbations 

initial temperature ^ perturb ations 

are attempted such that ^ ^ ^ ^ ^ amounts to lOd 
for every system varia ^ ^ attempts exceeds 100 

accepted perturbations, , ^ per turbations per 

rimes the number of variables ^ ^ ^ pf accep ted 
variable have been accep ^ ^ succ essive 

perturbations is ^ consid ered to have reached its 

temperatures, the sy . . . n concluded. This 

c=tate and the optimization is con 
lowest energy state, 

• - for the algorithm. 

is the terminating criterio min imization by 

Thus, simulated annealing is 

■ , the system being optimised 

first 'melting as a control 

effective temperature It* ^ temper ature at 

— - - — 

changes occur. 
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. filter 

^In^thm to construct the SU .-constrained MACE 
is presented below. 

— i = 1 , 2 , . • • » N c > Dy 

1. Obtain the training images 

■ . levels of distortions such as in- 

aDDlving the various level 

PP Y ^ C 4- r to the reference 

plane rotations, scale changes, etc, 

, , where N is the total number of images in the 
image (s) , where 

training set. 

♦ • A nai Fourier transform of 

2 . compute the two-dimensional Fourier 

training set images as i = 1 ' 2 ' ' * * Nt ' 

_ of X lexicographically to obtain the 
Order the elements of X A iexi y 

• _ s o m of size dxl where, 

column vectors X d . i ' 

d = NxN . 

, 4 -v-iv d where its diagonal 
Determine the diagonal matrix , 

elements are given by 

N t ,, (3.12) 

«>(..-> --sraS |Il<m)l 


3. 


4. 


5. 


The next part of the algorithm involves determining 
niter H, such that the following objective function is 
minimized, using the simulated annealing algorithm, as 
described in the previous section. 

i-1 


(3.13) 
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^2n__Of_y i ^g 

One issue that must be addressed h 
the user-specifi ed correlati ^ 1S ^ Selection of 

relation peak*? 

OUtPUt ™ a «°" plane for the O, the 

th * «l values in Eq . (3 u tfaini ^ These are 

^ ' •■‘■ 3 ). Since the fii*. 

3 «» characteristic, the COn «-lne d 

t0 th6Se ° UtpUt delation va lues p” ^ # " aXl '" U ”’ Umi t 
1 “ 9e thls correiation vaiue i . Si " 9le train ^ 

written i n th S 91Ven b y E( J* (3.4) It 

the — — co n t lnuous „ otatio ; ca " - 


I = fx'(u) H(u)du = A e J* t 


( 3 . 14 ) 


where 


and 


X(,U) = ^ X <t))=fX( u ) l e JOz(u> 

’ t 


H{U) = ^A(t)}=|^( U ) j e J0 M (u) 


( 3 . 15 ) 

represent the im* 

me image and filter ^ 

herS iS tD I in Eq (3 “ P 8 Ctlvel y- The objective 

arS constra ined to lle on ^ “* ValU£S ° f H(u > 

—Pic, as in Figure “ ° Peratln9 «»«•. (for 

the tec hnique suggested by Pa rn he « Allows 

y Pern and Goodnan (10] . 
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consider the equation 

A <„ - R etUX-(u)H(u)dule^l 

(3.16) 

= /KelX-(u) H(U) e-^du 
= /|X(u) | |H(u) | cos[0 H (u) -0 x (u) a * 

(3 16) is to be maximized over the region of 

Here Eq ' that is the SIX constraint. Thus 

realizability of H, that as, 

"ft .<«» - Jft / l*‘“» COSl 6 “ <U> - 6 ' <U '‘ 

H{U) (3.17) 

, onHv for each frequency u, 
H(u , can be chosen independently 
Since H (u) can 

Eq. (3-17) can be written as 

. . max { ltf(u) cos [0 W ( U ) " dU ' 

max A(«) = f l x(u)1 H(u) l,i “ 

HiU) J (3.18) 

. - (3 18) to determine the maximum correlation 

Calculating Eq. (3.1 > intensive. The 

• n hp very computation m 

value directly « ^ as £ollous . consider the 

procedure can 

intermediate function defined as 


G (*> - ^) iRelH{U) e ‘ J *” 

max (|h(u) jcos [0 H (u) ~4>^ ■ 


(3.19) 


ton G can be computed in advance as per Eq. (3.1 ) 

- - 
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SLM constraint) is known. Further G is periodic. 

Substituting Eq. (3.19) in Eq. (3.18) gives 

roax A{a)m f\ X (u)\G[a+e x (u)) du. (3 ' 20) 

It is much easier to calculate Eq. (3.20) since the function 
G is already known. 

The above equations can be written in discrete form. In 
the following equations the overbar notation represents the 
discrete form of the respective signals. The constraint 
function is discretized by sampling its phase into N values 
with increments of 6, where N is an integer. 

Thus 


The phase-magnitude tabular data used in the optimization 
procedure of the SLM-MACE filter (as explained in Section 3.2) 
can be used here. The discrete version of Eq. (3.19) can be 

written as 

G(n)= 3 ( a ^{|p(k) | cos [ (n H (k) -n)t>] ), n = 0,1, . . . , N-l , 

(3.22) 

where n H can only take on integer values. In Eq. (3.22) the 

H(k) values are chosen from the phase-magnitude data mentioned 

above. Thus the values for G(n) can be computed as per Eq. 

ion of Eq. (3.20) can be written as 


(3.22). The discrete vers 
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below. The phase values of the sampled image ~X(k) are 
quantized to the value n x b , where n x represents integer 

values. Thus 

A (n) = | X{ k) | G [ n-n x (k) ], ji = 0 , 1 , . . . , N- 1 , (3.23) 

Jc-o 


where d is the total number of pixels in the digitized image 
X(k) . Since the values are already known and it is 

periodic, computing the values for the function is much 
easier as opposed to solving Eq. 3.18. The maximum value of 
the function A(n) gives the maximum possible correlation value 
at the origin for the image x(t) if the filter is constrained 
to lie on a given SLM operating curve. 

3.3. Summary 

In this chapter the development of the SLM- Constrained 
MACE Filter was discussed along with the simulated annealing 
technique of optimization which was used in the filter design. 
The algorithm used for the synthesis of the filter was also 
presented. In the following chapter the distortion- tolerance 
performance of the SLM— Constrained MACE filter is evaluated 
with the help of computer simulation results. The performance 
of the filter is also evaluated in the presence of background 
noise in the input image. 



CHAPTER 4 

Performance Evaluation of 
the SLM-MACE Filter 


in Chapter 3 the development of the SLM-Constrained MACE 
Filter was discussed. An algorithm for its construction was 
also presented. In this chapter the distortion tolerance 
properties of the SLM-Constrained MACE filter and its 
performance in the presence of input noise are studied using 

computer simulations. 

4.1. Simul ation of the SLMz 

rnnstrai npH MACE Filter 

The SLM-Constrained MACE filter was simulated on a 
computer using the algorithm described in Section 3.2.3 of 
Chapter 3. Henceforth this filter is referred to as the SLM- 
MACE filter. The filter was synthesized to discriminate 
between two images consisting of the landscape of Mars. These 
images are referred to as marsl and mars2 and are shown in 
Figures 4.1 and 4.2. The two images are classified as 
belonging to Class I and Class II, respectively. These two 
images of pixel size 32x32 are padded with zeroes to generate 
64x64 pixel images. The SLM-MACE filter is simulated to 
discriminate not only between the two reference images marsl 
and mars2 but also between their distorted versions. The 
distortions considered here are in-plane rotations. 
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Figure 4.1. The Image marsl 



Figure 4.2 


The Image mars2 




53 


The SLM-MACE filters were constructed using three 
different constraints. Figures 4.3 and 4.4 show the first two 
constraints referred to as CONI and C0N2 respectively. The 
figures illustrate the magnitude-phase relationship that 
should be maintained for the filter in order for it to be 
implemented on an SLM with these constraints. The third 
constraint considered was the Phase-Only Filter (POF) type. 
For this constraint the magnitude is unity for all phase 
values. The SLM-MACE filters were synthesized for the three 

SLH to address the two-class pattern recognition 

problem mentioned earlier. The training set images for the 

filters were evenly distributed within the angle of rotation 
of the two images. 

The database used to test the recognition 
(classification) and distortion tolerance of the filters 
consisted of nine images (training as well as non-training) of 
each class. The nine images were obtained by rotating the 
images marsl and mars2 through angles zero to eight degrees. 
Besides their ability to distinguish between the two classes, 
the filters are evaluated on the basis of their correlation 
Plane energy and the peak-to-sidelobe ratio (PSR) in the 

correlation plane. The threshold used for separating class 1 
from Class II was 


T = 0.25 u 2 + 0 . 75 u 2 , 


(4.1) 


where and u 2 are the user-specified values for the filter 





itude 
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response at the origin of the correlation plane for Class I 
and Class II images, respectively. The weight for Class I was 
kept low since u, > u 2 by choice. The pattern classification 

problem can be extended to the multiple classes case as well. 
In that case the number of thresholds required to discriminate 
between the different classes would be more than one. In the 
next section the distortion test results for the SLM-MACE 
filter are presented. 

Two other filters were simulated on the computer for 
comparison with the SLM-MACE filter. One is the analytical 
MACE as discussed in Section 2.1 of Chapter 2. The MACE filter 
so obtained has arbitrary complex values and thus cannot be 
implemented on practical SLMs. To implement the analytic MACE 
filter on a SLM with known operating characteristics, it was 
modified as follows. At each frequency the phase value of the 
MACE filter was retained while its magnitude value was changed 
as per the phase-magnitude relationship of the constraints 
(CONI, CON 2 , or the POF type). This modified MACE filter is 
referred to as the Mod-MACE filter. The distortion test 
results of the SLM-MACE filter are compared to that of the 

MACE and Mod-MACE filters. 

4.2. Distortion Tes t Results 
The distortion-test results for the SLM-MACE filter along 
with that of the MACE and the Mod-MACE filters are presented 
in this section. All the filters were correlated with both 
training and non-training images of Class I and Class II. The 
peak value from the resulting correlation plane was compared 
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to the threshold value T (Eg. 4.1). if the resulting 
correlation peak value was greater than T, then the input 

image was said to belong to Class I, otherwise it was 
classified as a Class II image. 

4.2.1. Initial Test Rpgnifc 

In the initial tests the training set for the filter 
synthesis consisted of two images from Class I and Class II, 
respectively. The training images for Class I consisted of two 
rotated versions of marsl, where the angles of rotation were 
zero and eight degrees. Similarly, the training images for 
Class II were obtained from the image mars2 . Using these four 
training images three SLM-MACE filters were synthesized for 
the constraints CONI, C0N2, and POF. 

Now the values at the origin of the output correlation 
plane should be specified. As discussed in Section 3.2.4 of 
Chapter 3 it is important to know the maximum permissible 
output correlation peak values for each of the training images 
for the three constraints. Thus the specified peaks should be 
smaller than these maximum values. Using Eq. (3.23) the 
maximum correlation values at the origin were computed and are 
summarized in Table 4.1 below. The maximum correlation values 
for the two extreme images from each class are shown in the 
table. The corresponding values for the other images in the 
database lie within the two extreme values shown for each 
class. Thus, the specified correlation peak values must be 
less than the least value shown in Table 4.1 for each class. 
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Table 4.1 


, e **. the origin 

correlation Values at tn 
Maxitnuro Correx 



xnarsl.O 

roarsl . 8 

roars2 . 0 
mars2 . 8 


i.gTSE+oe 
2 . 456E+06 

!.902E+06 

2.372E+06 


1.803E+06 

2.226E+06 

1.731E+06 
2 . 146E+06 


2.921E+06 

3.583E+06 

2 .798E+06 
3.449E+06 


f o 80E+06 and 0.40E+06 were 
elation peak amplitude® o • c tively. f° r 

Correlatro P lBa ges, respective 

specified for Class 1 and a ^ peak 

- cases of tne _ spe eified f- Class 

amplitudes of 2' 1E+ ° 6 3 case o£ the P°F constraint. 

1 and Class II i- g es for ^ #>o £or class II images 

Ideally one would specify a v. ^ betwe en the values of 
so that there is sufficient d^^ ^ dUcrlBl nation 
the two classes. This wo correlation value at 

between the two classes. Howe- ^ ^ 

theory loss 

correlation plane will „ the detector at the 

would result in an error ^ ^ ^ it looks for the 

output of the optical corre a ^ require d image. To avoid 

peak to determine the ° ^ class H images were 

this the correlation peak j ^ ^ ^ niter 

specified to he half those o^ ^ CON i. COH2 and 

and the Mod-MACE filter ^ ^ ment ioned training 

also synthesized w 


POF) were 
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set images. The user-specified correlation peak amplitudes for 
these filters were the same as those specified for the 
corresponding SLM-MACE filters. 

The average correlation plane energy for the training 
images is given by: E av = H'DH. The E av values obtained for the 

SLM-MACE filters (CONI and C0N2) were 2.89E+09 and 1.23E+09 
respectively. These values are relatively large compared to 
t * le E av 3.32E+08 obtained for the corresponding MACE 

filter. The energies of 5.37E+10 and 1.482E+10 were obtained 
with the Mod-MACE filters for the constraints CONI and C0N2 
respectively. These values are much higher than those obtained 
for the corresponding SLM-MACE filters. The energy obtained 
with the POF SLM-MACE filter was 4.18E+10 which is much higher 
than the corresponding energy of 2.29E+09 obtained with the 
MACE filter. With the Mod-MACE (POF) filter the E av obtained 
was 5.37E+10 which is much higher than that of the 
corresponding SLM-MACE filter. 

The average correlation plane energy of the training 
images for a filter indicates its performance. A low value for 
the E av signifies a higher peak-to-sidelobe ratio (PSR) , 
sharper correlation peaks, and consequently more sensitivity 
to distortions in the test image. This is because sharp peaks 
are like delta functions with sharp fall-offs. Hence, if the 
training images for the filter are far apart then correlation 
peaks of the filter with the non-training images are also 
expected to fall sharply. As observed in the previous 



60 


. set o{ training images «" ““ 

paragraph, tor a grven CE the largest. The 

produced the smallest E a „ and value . Th en, 

sui-KACE filter achieved an ^ ^ ^ ^ be more 
based on the above com of a given class than the 

sensitive to the non-training -ges 

SLM-MACE tutor- three-dimensional plot of the 

- easwsit :ri— • 

output correlation plane f ^ along t he X and V 

- ^ ~ ^ C °rn seen from these two figures that 
ax es,respectivelV-ant,^ in ^ ^ ^ plan e, 

the peak occurs a r three-dimensional plots for 

namely, position ( 33 , > ^ ^ in Kig ures 4.8 and 

the MACE and Mod-MACE fi ^ plots , the correlation 

— tlVely ‘ ^rrlelohe suppression is excellent 

pea x is very sharp and ^ ^ ^ niter the 

in case of the « CE ^ MACE filter, hut the peaX is 

sidelobes are not sidelo hes, facilitating easy 

sharp enough relative Mod-MACE filter is 

detection. The correlation surface of h ^ ^ ^ 

a little poorer compared to the oth ^ be f airly 

. „ m-,1 the three filters * 

sidelobe suppression. chara cteristics. ft is to be 

go od in their correlation surf c variance and 

seen how they compare m 

classification. 
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;E-06 



Figure 4 . 6 . 


Correlation Plane 
(Through Origin) 


Values Along 
for SLM-MACE 


X-Axis 

Filter 




Figure 4. 


C 



8. The Correlation Plane Output for a MACE Filter 
Correlation Peak = 0.8E+06 Miter 

Correlation Plane Energy = 3.727E+08 



Figure 





4.9. 


The Corre 
Filter 

Correlation 

Correlation 


lation Output Plane for 
Peak 


M 


= 1 . 156E-06 

Plane Energy = 1.062E-10 


od-MAC 


The three SU.-MACE fitters (synthesized tor the . three 
constraints, and the corresponding MACE and Mod-MACE r er 
were correiated with the training and ^training r^s 

Misties for the Class I and Class 
correlation plane statist tested 

.for the SLM-MACE filters. For each tested 
training images for 

image the data include the speeded value at the origin 
the correiation plane, the iarqest observed peah in 

, „ the peak-to-sidelobe ratio (PSR) and the 

correlation plane, the pea 

m the case of all the tested images 
correlation plane energy. I 

- * a k in the correlation plane occurred 
the largest peak in tne 

fhe tables for the training images used 
origin. As seen from the tables, 

in the three SLM-MACE filters, the imposed cons rain 
origin of the correlation plane were satisfied. Also the 
values are reasonably high indicating small srdelobes. 


Table 4 • 2 


correlation Plane Statistics for SUi-MACE filter 
(using Constraint CONI) 


Test 

Image 


marsl . 0 
marsl . 8 


Specified 
Intensity 
at the 
origin 


0 . 800E+06 
0.800E+06 


Largest 

Peak 

Observed 


0.80E+06 

0.80E+06 


PSR 


210 

,743 


Corr . 
Plane 
Energy 


2 . 37 5E+09 
3.785E+09 


mars2 . 0 
mars2 . 8 


0 . 4 00E+06 
0 . 400E+06 


0. 40E+06 
0 . 40E+06 


1.903 

2.071 


2 . 079E+09 
3 . 346E+09 
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Table 4.3. Correlation Plane Statistics for SLM-MACE Filter 
(using Constraint C0N2) 


Test 

Image 

Specified 
Intensity 
at the 
origin 

Largest 

Peak 

Observed 

PSR 

Corr . 
Plane 
Energy 

marsl . 0 
marsl . 8 

0 . 800E+06 
0 . 800E+06 

0 . 800E+06 
0. 800E+06 

4 .115 
3.534 

1. 173E+09 
1 . 573E+09 

mars2 . 0 
mars2 . 8 

0 . 400E+06 
0 . 400E+06 

0 . 400E+06 
0 . 400E+06 

1.824 

2.399 

9 . 434E+08 
1 . 242E+09 


Table 4.4. 

Correlation 
(Using POF 

Plane Statistics for SLM- 
Constraint) 

-MACE filter 

Test 

Image 

Specified 
Intensity 
at the 
origin 

Largest 

Peak 

Observed 

PSR 

Corr. 

Plane 

Energy 

marsl . 0 

2. 10E+06 

2.10E+06 

3.466 

3 . 4 32E+10 

marsl . 8 

2. 10E+10 

2 . 10E+10 

2.567 

5.434E+10 

mars2 . 0 

1.05E+06 

1. 05E+06 

1.620 

3 . 030E+10 

mars2 . 8 

1. 05E+06 

1.05E+06 

1.323 

4 . 820E+10 
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The same correlation plane statistics for the MACE filter 
and the Mod-MACE filters (for the three constraints) are shown 
in Tables 4.5, 4.6, 4.7, and 4.8, respectively. Again for all 
these filters, the largest peak observed in the correlation 
plane occurred at the origin. The correlation plane energies 
for the MACE filter are much lower than the SLM-MACE filters 
and consequently the PSR values are higher. In the case of the 
Mod-MACE filter the PSR values are lower than the SLM-MACE and 
MACE filters. From Table 4.5 it can be seen that the 
correlation peaks obtained from the images used in the MACE 
filter construction satisfied the imposed constraints at the 
origin. However, the same is not true for the Mod-MACE filters 
as observed in Tables 4.6, 4.7, and 4.8. Here the correlation 
peaks are much higher than the values specified in the imposed 
constraints. This will affect its recognition capability as 
will be seen later on in this chapter. 
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Table 4.5. 


Correlation Plane Statistics for the MACE filter 


Test 

Image 

Specified 
Intensity 
at the 
origin 

Largest 

Peak 

Observed 

PSR 

Corr. 

Plane 

Energy 

marsl. o 
marsl . 8 

0.80E+06 
0 . 80E+08 

0. 80E+06 
0. 80E+08 

7.232 

7.393 

3 . 727E+08 
3 . 856E+08 

mars2 . 0 
mars2 . 8 

0 . 40E+06 
0. 40E+06 

0. 40E+06 
0. 40E+06 

3.426 

3.881 

2 . 746E+08 
2 . 961E+08 


Table 4.6. correlation Plane Statistics for Mod-MACE filter 
(Using Constraint CONI) filter 


Test 

Image 


Specified 
Intensity 
at the 
origin 


Largest 

Peak 

Observed 


PSR 


Corr . 
Plane 
Energy 


marsl . 0 
marsl. 8 


0 . 80E+06 
0.8 0E+06 


2.33 0E+06 
2.924 E+06 


2.859 

2.963 


3 . 821E+06 
6 . 054E+10 


mars2 . 0 
mars2 . 8 


0 . 40E+06 
0 . 40E+06 


1. 634E+06 
2 . 121E+06 


2.170 

2.294 


3 . 374E+10 
5. 372E+10 
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Correlation Plane Statistics for Mod-MACE filter 
(Using Constraint CON2) 


Specif ied 
Intensity 
at the 
origin 


Largest 

Peak 

Observed 


Corr . 
Plane 
Energy 


0.80E+06 
0. 80E+06 


1 . 156E+06 
1 . 456E+06 


1 . 062E+10 
1 . 672E+10 


0.40E+06 
0 . 40E+06 


0 . 809E+06 
1 . 054E+06 


0 • 936E+10 
1 . 482E+10 


Correlation Plane Statistics for Mod-MACE filter 
(Using Constraint POF) 


Test 

Image 


Specified 
Intensity 
at the 
origin 


Largest 

Peak 

Observed 


Corr. 

Plane 

Energy 


marsl. 0 
marsl . 8 


2.10E+06 
2. 10E+06 


2 . 330E+06 
2 . 924E+06 


2.865 

2.970 


3 . 432E+10 
5 . 434E+10 


mars2 . 0 
mars2 . 8 


1.05E+06 

1.05E+06 


1 . 634E+06 
1. 121E+06 


2.172 

2.298 


3 . 030E+10 
4 . 82 0E+10 
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The correlation test resets for the SI24-MACE filter for 
the training and non-training images along with those for the 
MACE and Mod-MACE filters are summarized in Table 4.9 as Test 
Numbers 1 through 7. The training images used for each class 
for all the filters were the base images marsl and mars2 

rotated through zero and eight degrees. 

in order to classify the test images between the two 

classes the threshold T was chosen as 0.5E+06 (from Eq. 4.1 
with Ul - 0 . 8E+06 and u 2 - 0 . 4E+06, for the SLM-MACE and Mod- 

MACE filters (with constraints CONI and C0N2). The same 
threshold was used for the MACE filter. In the case of the POF 
constraint, T = 1.312SE+06 (since u 2 = 2.1E+06 and u 2 - 

1.05E+06) for the SLM-MACE and Mod-MACE filters. As seen in 
Table 4.9 the s 111 -MACE filters recognized the test images 
correctly on every occasion. However, in the case of the MACE 
filter some non-training images from class I were 
misclassif ied giving a recognition of 56 percent. This is 
because the MACE filter gives sharper correlation peaks than 
the SLM-MACE filter making it sensitive to non-training images 
of a given class. Thus the performance of the SLM-MACE filter 

was better than the MACE and Mod-MACE filters. 

A graphical representation of these results is given in 
Figures 4.10-4.14. In each of these figures the global 
correlation peaks are plotted against their respective image 
numbers. The Class I images are represented with a O and the 
Class II images are represented with a □. 
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The solid symbols denote the images used in the training set 
for the two classes. The solid line denotes the threshold 
level used for classifying the images. If the global 
correlation peak for an image falls above this line then it is 
classified as a Class I image, otherwise it is a Class II 
image. As opposed to the SLM-MACE and MACE filters the imposed 
constraints at the origin of the correlation plane are not met 
in the case of the training images of the Mod-MACE filter. As 
seen in Figure 4.14 this resulted in all the correlation peaks 
falling above the threshold level for the Class II images for 
this filter. Hence it achieved a recognition rate of 0 for 
Class II. 

4.2.2. Further Tests with I ncreased 
Number of Training Images 

As seen from the earlier test results, the distortion 
tolerance of the MACE and Mod-MACE filters is not very 
satisfactory. A way of improving the distortion tolerance 
capability of these filters to the non-training images is to 
increase the number of training images within the angles of 
rotation. Tests 1-7 were repeated with three training images 
for each class. These three images were the base image of each 
class rotated through angles zero, four, and eight degrees, 
respectively. The results of these tests are summarized in 
Table 4.10 as Tests 8-14. As seen in Table 4.10, increasing 
the number of training images resulted in 100 percent 
recognition for both the Classes in the case of the MACE 
filter (Test 11) which is an improvement over the 
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corresponding MACE filter from Table 4.9 (Test 4) . But this is 
not true of the Mod-MACE filters (Tests 12-14). These filters 
continued to have 0 percent recognition rate for Class II 
images. Although the global correlation peaks do occur at the 
origin as desired (for the Mod-MACE filters), the imposed 
constraints at the origin of the correlation plane are 
violated leading to poor recognition. 

However, there was an increase in the average correlation 
plane energies for all the filters in comparison to the 
corresponding energies from Table 4.9. This increase in 
energies had an uneven effect on the average PSR values for 
the two classes. This observation is made by comparing the 
average PSR values for the corresponding filters in Tables 4.9 
and 4.10, respectively. To further study the effects of 
increasing the training set images the same seven tests were 
repeated with training images spaced two degrees apart 
(between the angles zero and eight degrees) for each Class. 
Thus the number of training set images for each class is 
increased to five per class. The results of these tests are 
summarized in Table 4.11 as Tests 15-21. 

As seen in Table 4.11, increasing the number of training 
set images resulted in a further increase in the average 
correlation plane energies and a decrease in the average PSR 
values for all the filters. The recognition rate of the Mod- 
MACE filters was not affected by the increase in the training 
images. A brief summary of the distortion test results 
presented so far is given in the next section. 
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Table 4.9. Distortion Test Results for Filters Constructed 
with two Training Images from each Class 


Test 

No. 

Filter 

Object 

Class 

Percent 

Correct 

Avg. 

PSR 

Average 

Energy 

1. 

SLM-MACE 

(CONI) 

marsl 

mars2 

100 % 
100 % 

4.066 

1.931 

3 . 605E+09 
3 . 200E+09 

2 . 

SLM-MACE 
( C0N2 ) 

marsl 

mars2 

1 mm 

3.726 

1.952 

1 . 694E+09 
1. 386E+09 

3. 

SLM-MACE 

(POF) 

marsl 

mars2 

100 % 
100 % 

2.821 

1.374 

5 . 236E+10 
4 . 653E+10 

4. 

MACE 

marsl 

mars2 

56 % 
100 % 

5.455 

2.619 

4. 571E+08 
4 . 022E+08 

5. 

Mod-MACE 

(CONI) 

marsl 

mars2 

100 % 
0 % 

2.824 

2.098 

5 . 829E+10 
5. 180E+10 

6. 

Mod-MACE 
(C0N2 ) 

marsl 

mars2 

100 % 
0 % 

2.849 

2.117 

1. 620E+10 
1 . 4 39E+10 

7. 

Mod-MACE 

(POF) 

marsl 

mars2 

100 % 
0 % 

2.830 

2.100 

5. 226E+10 
4 . 653E+10 
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Distortion pst Results for Filters Constructed 


Tab le 4.10. D Stortion ^ per class 



Test 

No. 

Filter 

Object 

Class 

Percent 

Correct 

Avg. 

PSR 

Average 

Energy 

8. 

SLM-MACE 

(CONI) 

marsl 

mars2 

100 % 
100 % 

3.876 

2.013 

4 . 04 2E+09 
3 . 653E+09 

9. 

SLM-MACE 
(C0N2 ) 

marsl 

mars2 

100 % 
100 % 

4.119 

1.922 

2 . 082E+09 
1 . 7 63E+09 

10. 

SLM-MACE 

(POF) 

marsl 

mars2 

100 % 
100 % 

3.503 

1.592 

5 . 236E+09 
4 . 653E+09 

11. 

MACE 

marsl 

mars2 

100 % 
100 % 

7.084 

3.086 

5. 086E+08 
4 . 060E+08 

12. 

Mod-MACE 

(CONI) 

marsl 

mars2 

100 % 
0 % 

3.105 

2.187 

5 . 829E+10 
5. 181E+10 

13. 

Mod-MACE 
(CON2 ) 

marsl 

mars2 

100 % 
0 % 

3.135 

2.198 

1 . 620E+10 
1 . 440E+10 


i inn * 3.105 5.829E+10 
Mod-MACE marsl 100 % 5.181E+10 
/POF^ mars2 0 % z,1 °° 
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Table 4.11. Distortion Test Results for Filters Constructed 
with five Training Images per Class 


Test 

No. 

Filter 

Object 

Class 

Percent 

Correct 

Avg. 

PSR 

Average 

Energy 

15. 

SLM-MACE 

marsl 

100 % 

3.360 

5. 140E+09 


(CONI) 

mars2 

100 % 

1.775 

4 . 616E+09 

16. 

SLM-MACE 

marsl 

100 % 

3 . 122 

3.946E+09 


(CON2) 

mars2 

100 % 

1.624 

4 . 616E+09 

17. 

SLM-MACE 

marsl 

100 % 

2.366 

5 . 236E+09 


( POF) 

mars2 

100 % 

1.126 

4 . 653E+09 

18. 

MACE 

marsl 

100 % 

6.818 

4 . 855E+08 



mars2 

100 % 

2.960 

3 . 806E+08 

19. 

Mod MACE 

marsl 

100 % 

3.118 

5 . 829E+10 


(CONI) 

mars2 

0 % 

2.184 

5. 181E+10 

20. 

Mod MACE 

marsl 

100 % 

3.149 

1. 620E+10 


(CON2 ) 

mars2 

0 % 

2.198 

1 . 439E+10 

21. 

Mod MACE 

marsl 

100 % 

3.118 

5.829E+10 


(POF) 

mars2 

0 % 

2.184 

5. 181E+10 
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SLM-MACE filter so that the filter is constrained to take on 

values within the operating constraints of a given SIM. Any 

arbitrary SIM constraint can be used in the design of the SIM- 

E filter which makes it more suitable for implementation in 
practical OPR systems. 

4^-ls Noise Te st Resnu-o 

In this section the effect of background noise (in the 

lnput test images ) «« the performance of the filters is 
studied. The distortion invariance performance of the SLM-MACE 

mters is evaluated in the presence of zero-mean white noise 
at the input. The performance of the filter is also studied in 
the presence of a constant bias term added to all the pixels 

in the test image. Similar test result- c * 

test results for the MACE filter 

are presented for comparison. 

-4.3.1, Nois e Test-c 

To simulate the conditions under which inn,,*- • 

wnicn input images would 

zero-mean, white Gaussian noise was added to the 
images before correlating them with the filter. Noise with 
different signal-to-noise ratio values were added to all the 
images in the database (including class I and class ll, . 
total of eighteen images,. Figures 4.15 and 4.16 show the 
images marsl and mars! corrupted with noise. The slm-mace 

1 (US1 " 9 C °" Straint C0H2 > synthesized with five training 

9 ClaSS (aS ln Test 16 ' Table 4.H) was used 

to test an the noisy images in the database. As before the 

user-specified correlation peak values for class X and class 
II were 0.8E+06 and 0.4E+06. 


Figure 4.15. Image marsl with noise 
(SNR = 10 dB) 



Figure 4.16. Image mars2 with noise 
(SNR = 10 dB) 
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The same threshold as in Test 16 (T = 0.5E+06) was used to 
classify the test images as Class I or Class II images. The 
results of this test for various SNR values are summarized in 
Table 4.12. The same tests were performed for the 
corresponding MACE filter (Test 18, Table 4.11). The results 
of these tests are summarized in Table 4.13. 

As seen in Table 4.12 the SLM-MACE filter tolerates noise 
upto the 10 dB SNR level without any effect on its recognition 
capabilities. The same is true of the MACE filter as seen in 
Table 4.13. However, with the increase in the noise levels 
there is a drop in the correlation plane PSR values. For SNR 
values below the 10 dB level, the correlation plane value at 
the origin is dominated by the sidelobes resulting in poor 
recognition for those images. 


Table 4.12. Noise Test Results for the SLM-MACE Filter (for 
Constraint CONI) 


SNR 
in dB 

% 

marsl 

Recognition 

mars2 

marsl 

PSR 

mars2 

20 

100 

% 

100 % 

3.23 


1.64 

15 

100 

% 

100 % 

3.03 


1.67 

10 

100 

% 

100 % 

3.01 


1.40 

5 

100 

% 

22 % 

2.62 


1.38 

0 

100 

% 

67 % 

1.99 


1.11 
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Table 4.13. Noise Test Results for the MACE filter 


SNR 
in dB 

% 

mars 

Recognition 

mars2 

marsl 

PSR 

mars2 

20 

100 % 

100 % 

6.20 


2.54 

15 

100 % 

100 % 

4.98 


2.30 

10 

100 % 

100 % 

3.63 


2.01 

5 

100 % 

11 % 

1.78 


1.02 

0 

22 % 

0 % 

1.10 


1.14 


4.3.2. Bias Correction 

One other factor which should be addressed while 
simulating real testing conditions for the filter is the 
effect of input bias [37]. A constant noise term added equally 
to all the pixels of the input image can be considered a bias 
term. This will affect the correlation peak and PSR values in 
the correlation plane. 

To correct this bias in the input image it is required 
that the cross-correlation of the filter and a random (but 
spatially constant) bias signal be zero [38]. Thus the 
required condition can be written as 

h T C = 0 , (4.2) 


where c = [1 1 1 ... 1] is the spatially constant image in vector 
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notation and h is the filter in the spatial domain. Thus the 
inner product of the filter and a constant image should be 
zero. This condition will ensure that uniform bias term added 
to the input image will not degrade the peak values in the 
correlation plane. This can be incorporated into the filter 
design by including a constant image in the training set and 
setting its corresponding correlation output to zero. To show 
that the above scheme helps prevent the degradation of the 
correlation plane PSR due to the addition of a bias term in 
the input image, one example situation was simulated on the 
computer . 

An SLM-MACE filter was synthesized (using Constraint 
C0N2) for a single reference image of marsl. The output at the 
origin of the correlation plane was specified as 0.8E+06. 
Another SLM-MACE filter was synthesized for the same image 
with an additional image included in the training set and its 
correlation output at the origin was constrained as in Eq. 
4.2. Similarly, two MACE filters were synthesized (with and 
without the bias correction) for the same image marsl. All 
these four filters were then correlated with different biased 
versions of the training image marsl. The results of these 
tests are summarized in Table 4.14. The table indicates the 
PSR values obtained with the four filters for various bias 
levels added to the training image. 

As seen in Table 4.14 the PSR values for the MACE filter 
(constructed without the bias correction) dropped steadily 
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Table 4.14. Correlation Test Results of the Filters with 
Biased Versions of the Test Image 

HI = Filter Without Bias Correction 
H2 = Filter With Bias Correction 




PSR Values 

for 



MACE 

Filter 

SLM-MACE Filter 
(Constraint C0N2) 

Bias 

HI 

H2 

HI 

H2 

10.0 

9040.55 

4094.67 

9.01436 

8.86552 

20.0 

4521.25 

4094.69 

9.01434 

8.86552 

30.0 

3014.54 

4094.69 

9.01432 

8.86552 

40.0 

2261.16 

4094.69 

9.01430 

8.86552 

50.0 

1809. 13 

4094.69 

9.01428 

8.86552 

60.0 

1507.77 

4094.69 

9.01426 

8.86552 

70.0 

1292.49 

4094.69 

9.01424 

8.86552 


with increasing bias levels. This situation was rectified in 
the case of the MACE filter constructed with the bias 
correction. Here the PSR values remained steady for similar 
increases in the bias level. However, it was observed that in 
the case of the SLM-MACE filter, increasing the bias levels in 
the input image did not degrade its PSR values considerably. 
There was not much difference in the PSR values for the SLM- 
MACE filters constructed with and without the bias correction. 
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Thus it can be concluded that the SLM-hace filter can tolerate 

significant bias levels in the input image while maintaining 
a reasonably steady PSR value. 

4... 4. Reducing Com putation ts 
As discussed in chapter 3, the simulated annealing 
technique of optimisation is used for the synthesis of the 
SLM-MACE filter. It took approximately five hours of CPU time 
on a sun SPARC1+ workstation to run the computer program for 
the SLM-MACE filter synthesis. It would be desirable to modify 
this procedure in some way so that less computation time is 
required without affecting the distortion capabilities of the 

filter. In this section one such method is presented along 
with computer simulation results. 

In real images most of the energy lies in the low 

frequency region of the spectrum, in Reference [39, Bahri has 

used square windows (centered at the origin, i„ the frequency 

domain to reject the high frequency components of the 

reference image. The Phase-Only filters created using this 

reference image was designed to yield high SNR values for 

detection of a single image corrupted with noise. A similar 

technique can be used here to ignore some of the training 
image pixels. 

the filter pixels are the variables in the 
optimization procedure, the computation time required for the 
synthesis of the SLM-mace filter (using optimization, depends 
on the size of the images. If only a limited number of pixels 
from the training images are used for the optimization then 
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the computation time required could be reduced. The 

corresponding filter pixels which are not considered for the 

training images can then be set to zero. This scheme was 

applied in the design of the SLM-MACE filter in the following 
manner. 

A threshold is set for the magnitude of the frequency 
components of the training images depending upon their range 
of values. All training image pixels which have magnitudes 
below this threshold are then ignored during the filter 
synthesis. The threshold has to be selected such that only the 
low magnitude frequency components are ignored. The same 
algorithm as outlined in Section 3.2.3 (Chapter 3 ) is followed 
with a few modifications. In Step 5 of that algorithm, the 
diagonal elements of the diagonal matrix D are the average 
magnitude squared values of all the training images. Those 
diagonal elements of D which fall below a preset threshold are 
set to zero. The corresponding pixels in the training images 
are also set to zero. Now, a new diagonal matrix D is created 
Which includes only the nonzero diagonal elements of the 
original D-matrix. This new diagonal matrix will have a 
reduced number of diagonal elements than the original matrix. 
Similarly, new training images are formed which include only 

the pixels corresponding to the nonzero diagonal elements of 
the original D-matrix. 

The new D-matrix and training image vectors are then used 
in the objective function (Eg. 3.13, chapter 3). Thus the 
filter H and the training image vectors x s in Eq. 3.13 have 
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a reduced number of pixels. The SLM-MACE filter is synthesized 
by minimizing Eq. 3.13 subject to the SLM constraints. The 
computation time required for the optimization will be reduced 
depending upon the reduction in the number of pixels of the 
original training images. The original filter is then 
recreated by placing the optimized filter pixel values in 

their respective positions and setting the rest of the filter 
pixels to zero. 


The SLM-MACE filter from Test 9 (Table 4.lo) was re- 
synthesized using this scheme. The number of training images 
sed were three per class, and the SLM constraint used was 
COM2 (as in Test 9). The original training images and the 
filter were of size 64x64. A Threshold of 0.15E+06 (based on 
the D-Matrix values) was chosen for selecting the pixels for 


the new training images from the original ones. The number of 
Pixels in the new training images and the filter was found to 
be 2122 . This is nearly half of the original number of pixels 
(i.e. 4096). As expected the pixels which were turned 'OFF' in 
the original training images were from the high frequency 


region. The computation time taken for the synthesis of this 

filter was nearly 50 percent of the original program which 
amounts to considerable savings. 

To evaluate the performance of this filter, all the 
images m the database were correlated with it. The results of 
this test are summarized in Table 4.15. The user specified 
rrelation peaks for the training images were 0.8E+06 and 
0 . 4E+06 for Class I and Class II, respectively. The Threshold 
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used for classification was 0.5E+06 (as in Test 9). Figure 
4.17 shows a typical three-dimensional plot of the correlation 
plane for this filter. As seen in this figure the sidelobe 
suppression is good with a reasonably sharp peak. 

As seen in Table 4.15, the distortion invariance 
properties of the filter are not affected by reducing the 
number of pixels in the training images. However there is an 
increase in the average correlation plane energies and a 
consequent decrease in the average PSR values as compared to 
the original filter (Test 9, Table 4.10). 


Table 4.15. 


Correlation Plane Statistics for the SLM-MACE 
Filter (Constraint CON2) Constructed with Reduced 
Number of Pixels 



Object 

Class 


Percent Average 

Correct PSR 


Average 

Correlation 

Energy 


marsl 


100 % 


3.370 


3 . 237E+09 


mars2 


100 % 


1.713 


2 . 703E+09 
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In this chapter the distortion tolerance properties of 
the SLM-MACE filter were studied via computer simulations. The 
filter performance was compared to that of the analytical 
MACE, and the modified analytical MACE filters. Three 
different constraints were considered for the SLM-MACE filter. 
The SLM-MACE filter performed appreciably well in terms of its 
distortion invariance to the non-training images. It also 
performed well in the presence of noise and added bias levels 
in the input images. On the other hand, the modified 
analytical MACE filter showed poor recognition properties. A 
method to reduce the computation time required for the 

synthesis of the SLM-MACE filter was also proposed and 
studied. 


CHAPTER 5 


Summary and Recommendations 

The research work leading to this report involved the 
design of a correlation-based distortion-invariant filter 
which can be used in an optical pattern recognition system. 
Specifically, this filter can be implemented on available 

spatial light modulators (SLMs) with their arbitrary 
realizability constraints. The SLMs considered were those 
exhibiting a phase-magnitude cross coupling (for example, a 

deformable mirror device (DMD) ) . 

5.1. Discussion 

in this report the design of a SLM-constrained minimum 
average correlation plane energy (MACE) filter was presented. 
An algorithm for its synthesis was also discussed. The SLM- 
MACE filters were then synthesized using three different 
constraints. To evaluate the performance of this SLM-MACE 

filter, distortion tests were carried out using computer 

simulations . 

To date no methods have been developed to design SLM- 
constrained filters using purely analytical techniques. The 
methods proposed in the literature involve the use of certain 
optimization procedures. In this report the simulated 

annealing technique of optimization was used in the design of 
the SLM-MACE filter. The optimization criterion used was the 
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minimization of the average correlation plane energy of the 
filter. There were two specific constraints for this filter 
design. One is maintaining the user-specified values at the 
origin of the output correlation plane. The other is that the 
filter can take on only those complex values which meet the 
realizability constraints of a given SLM. 

The distortion test results of the SLM-MACE filter were 
compared to that of the original analytical MACE filter and 
its modified version. Basically the analytical MACE filter was 
modified such that it would meet the SLM constraints (since it 
normally has arbitrary complex values which cannot be realized 
on available SLMs) . The characteristics of the correlation 
planes obtained using the SLM-MACE filter were good with low 
sidelobes and a sharp correlation peak at the origin. However, 
the energy minimization of the SLM-MACE filter was not as good 
as the analytical MACE filter. Using the SLM-MACE filter the 
non-training images were correctly identified as belonging to 
the right class in an intra-class pattern recognition problem. 
This demonstrated the invariance of the filter to distortions 
in the input image. 

On the other hand the modified analytical MACE filter 
response was not good with respect to the correlation plane 
energy minimization. Moreover it performed poorly in 
identifying images as belonging to a particular class. This 
was because the correlation peak constraints for the training 
images were violated caused by the modification. Thus it can 
be concluded that the MACE filter is not suitable for 
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implementation on some presently available SLMs with their 
limited modulating capabilities. Hence, in the future, 
correlation-based optical pattern recognition filter designs 
should take into account the realizability constraints of 
available SLMs. 

The SLM-MACE filter performed reasonably well when the 
input test images were corrupted with white gaussian noise. 
When the test images were corrupted with a constant bias term 
there was no significant deterioration in its performance 
unlike the analytical MACE filter. However, the computation 
time involved in the synthesis of the SLM-MACE filter was 
considerable. A technique to reduce the computation time was 
also presented. 

5.2. Recommendations 

Although the SLM-MACE filter performs reasonably well and 
can be implemented on currently available SLMs, the synthesis 
procedure presented in this report has certain limitations. 
Also, there are certain possible extensions to this research 
and they are discussed in this section. 

Some other optimization techniques which would require 
less computation time for the design of the SLM-MACE filter 
can be investigated. A possible variation to the SLM-MACE 
filter design can be the inclusion of the constraints (at the 
origin of the correlation plane) within the average 
correlation plane energy equation of the MACE filter. This 
way, these constraints will not have to be added to the 
correlation plane energy function (for example, using the 
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penalty function technique) as was done in this report. The 
energy function which includes the constraints could then be 
minimized using some optimization technique to determine the 
MACE filter such that it is constrained to an SLM operating 

region. 

The SLM-MACE filter design concept can be extended to 
include the minimization of the variance in the output due to 
noise in the input images. Further, there is potential in 
pursuing the use of the SLM-MACE filter to estimate the 
orientation of an object as was done using the synthetic 
estimation filter. The design for a SLM-constrained composite 
filter can be modified by considering some other performance 
measures for optimization, for example, the peak to 
correlation energy or the signal-to-noise ratio. 
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APPENDIX 


C 

C PROGRAM SLM_MACE. FOR 

C 

C 

C This program solves the SLM-constrained MACE filter problem 
C using the simulated annealing method of optimization. The 
C number of variables in the optimization are L = N*N (The 
C size of the training images and the filter being NxN) . 

C 

C A Total of upto 10 training images can be used in this 
C program, i.e. 5 for Class I, and 5 for Class II. 

C 

C 'COMPUTEFN' is the routine which evaluates the objective 
C function at the given variable values. 

C 

C 

C ************************************************************ 
C 

C Definitions of some important variable names used. 

C 

c 

C N,M == NxN or MxM are the Image/Filter dimensions. 

C 

C L == Total no. of pixels in the Images ( i.e. = NxN) . 

C 

C KKK == Number of training Images. 

C 

C iter == Maximum number of iterations permitted. 

C 

C ased, bsed, sed == Contain the seed values for use in the 
C random number generation function. These seed values are 
C generated using the 'secnds' function in FORTRAN. 

C 

C vail, val2 == User-specified peak-values for Class I and 
C Class II resp. 

C 

C kl, k2 , k3 == Constants used in the Penalty functions for 
C the constraints of the objective function. 

C 

C XX == Array of dimension LxKKK . The adjacent columns of this 
C array contain the real and imaginary parts of the 

C training Image vectors. 

C 

C dmat == Array of dimension L. Contains the average of the 
C (magnitude) **2 of all the training Image vectors. 
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c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 


Cg t 104 

in two columns Representing the^h^ the SLM ~ c ontraints 
respectively. ^ the P base and magitude 

filter pixeli. t d*lt* r i ,1 (2»«w n ( ® ° f , the phase of the 

‘ * / (total number of samples, 

values of r ?he°phfserif°? h e' f “ t “ n ‘ ain ? the temporary 
optimization. filter pixels during 

^ Array of dimension L it win . . 

^values of the pixels of the optimi^ed'f i^lrf Ph3Se 

3 resulting a ^| n , t a e S u|*“| s ^ 1 t h= objective function 
during an iteration of the oot im? rb ^ 10n ° f a variab le 
function ' COMPUTEFN' also return* a £ ion process. The 
objective function in 'obif'* S * he Value of the 
optimization 'objf' win the end of the 

function value. J 11 contain the final objective 


obj^^^^^^nc^on^as^^esult^of^ o, the 

energy. ntainS th ® Value of the average correlation plane 

correlation ^lfne ^ne^gy ***9°**^ Value of the 
of filter pixel phasl ^i ue ^ ^ ° f the Perturbation 

con Array of dimension KKKx 2 h<-»ih 

imaginary parts of the correi At?? ldS the real and 
the two entries of each row. ” peak const raints as 

°f the above constraints^.** 2 * Holds the temporary values 

T ay ° f . dimenSi ° n - ** explanation) 

function C obtainId t 5Sring S thI a op?i° f th ? ob i ect ive 

p^r th 0 ! tS'ftnSSP. 

The corresponding phase values^of ln /n,inob jf'. 

stored in the array 'minx* Thi« • ^ fllter Pixels are 
SUBROUTINE REC. ’ Tbls ls done by calling 


c* * ******* ****************** 
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inte96f 2 H kkk iter,N0,devl 

integer mm,oncem,NN,M,L,KKK, irei , 

integer sed, ased , bsed , pp, count 

real^sedl^sed2 tSd3?minob j f , thi , nob jo, nob jol 

parameter (M=64) 
parameter (L=4096) 
parameter (KKK=4 ) 

integer*2 ipint(M,M) minX ( L) , neon ( KKK , 2 ) 

rial val2“ftl«,rifil, i^i^po e 

real randnun.1 , randnum2 , delta , prob, 

real objo,objf ,xi,xr,txi,txr,p » . ■ ,u «\ 

complex ipc(M # M) 11^^3*14 

character filenamel*14 , filenames 
character filename4*14 


common N 


N=M 

devl=6 

sed 1 —4 0000 . 0 
sed2=50000. 0 

sed 3 =90000 . 0 

pp = 0 

accept - 0 
attempt = 0 
NN = 0 
oncem=0 
mm=0 

pai=3. 141592654 


C Generate the seed values for use 
C generation function 'RAN 


in the random no. 


ased=abs ( 2 * ( int ( seends ( sedl ) ) ) +1 ) 
sed=abs ( 2 * ( int ( seends < ^ed2 ) ) ) + 1 ) 

bsed=abs (2* (int (seends (sed3) ) )+l) 

iter = 10000 


val 1=8 00000 . 0 
val2=400000 . 0 


kl=100.0 
k2=200 . 0 


k3=50 . 0 

delta=3 . 0691964E-03 



106 


32 

1 


C ' images4 . na ' contains the names of the ' gaining ' i”^es which 

c c .-s-f'&r 

§ S^SSSLfi-ST p”«u“« computed and stored in 'dmat>. 

f ilenamel=' images4 .na' c <-aHis='old') 

open (unit-11, file-filenamel, status- old ) 

read (11 , l,end=900) filename2 

format(al2) 

call getintl ( ipint, f ilename2) 
call int_rl ( ipint , ipr) 

do j=l,N 

do i=l , N . 

ipc ( i , j ) =cmplx ( ipr ( i » J ) ) 
end do 

end do . 

call tdfft(1.0,xpc,ipf) 
mm=mm+l 
j j=0 

do i=l,N 
do j=l,N 

XX(jj,mm) = real(ipf (i» j)) 
vv Ttun+1) = a iinag ( ipt ( i / J J J 

Sit (5” - d»t(ji)+(«ciJ.-)«*)* 

^ (XX (j} , mm+1) **2) 

end do 
end do 
mm=mm+l 

C Get the next training image, 
go to 32 

C Take the average of all the elements of 'dmat' . 


900 d dmat (i)=dmat(i) /float (KKK) 
end do 


C Initialize the array which will contain 
C table. 

do i=l ,4096 
do j=l,2 

cst ( i , j ) =0 • 0 
end do 
end do 


the SLM-constraints 
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C Read the SLM-constraiht data file into the array 'cat'. 

open<unit=ll,file='cstraintn.in2048'.status='old'> 

do i=l ,2048 . 

read (11,*) (cst(i,l) 
end do 

oinsefunit=ll) 


C Determine the starting pointsfor ^the °^^^ a are those 
C obtained ^t^ piously -^Analytical MACE filter 

“GE?CH?' S iran e un)orna?ted-read routine which reads the 
complex filter into an array filtl . 


C 

C 

C 

C 


f ilename4=' f ilt224 . s64 ' 

call getcmp( filtl , f ilename4) 
ii=0 

do i=l,N 
do j=l,N 

phase=atan 2 (aimag (f iltl( i» j) ) , real (filtl (i, j) ) ) 
if (phase. It. 0.0) then 
phase=phase+ ( 2 . 0*pai) 

tempxl ( ii) =cst (nint (phase/delta) ,1) 

end do 
end do 


muj. 2 — another wav of determining the 
C Initial Guess. This is another y filter pixels 

c c siti “t- « 

C randomly from the SLM-constraints table. 

C 

c do i=l,L 

C Nl=int(2048.0*ran(sed) ) 

q tempxl ( i) =cst (N1 , 1) 

C end do 


C routine* COWUT EFN 4TaTua t" s" the objective function value at 
C the gTven points of the filter pixel values. 

do i=l , L 

X(i)=tempxl(i) 

420 cal ^compute fn ( NN , L , KKK , XX , X , dmat f cst , kl , k2 , k 3 , 

4 $ delta, vail, va 12 , obi o, obi f, con) 
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if ( 


oncem . ne . 0) then 

perc=( (oldf-objo) /oldf ) *100 

oldf =objo 

if (perc. le. (2.0)) then 
count=count+l 


else 

count=0 
end if 
else 

oldf=objo 
end if 


c The initial value of the temperature 'tempo- is got from the 
c starting value of the objective function °b}f • 

C also created. 


FF(l)=objf 
temp0=ob j f / 2 . 0 

temp=temp0 . . 

call rec (L, X,minX, objf ,minob;)f ) 

write (25, *) 0,objf 
write ( 26 , * ) 0 , objo 
write (27, *) oncem, objf 

write ( 28 ,*) oncem, objo 
if (count. ge. 3) go to 500 
oncem=oncem+l 


C **** The optimization iterations begin here 

write (devl , *) ' PERFORMING OPTIMIZATION !! PLEASE WAIT' 
write (devl , *) ' ' 

do i=l, iter 
do j=l,L 

pp=pp+l 


C Generate 
C negative 


a random no. to determine whether a positive or 
perturbation be caused for each variable. 


randnuml=ran (ased) 

if (randnuml . le . 0 . 5) then 
X ( j ) =tempxl ( j ) + (delta) 
if((nint(X(j) /delta) ) .gt. 2048) then 
X( j)=delta 
end if 
else 

X ( j ) =tempxl ( j )- (delta) 

if ( (nint(X(j) /delta) ) . It. 1) then 
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X(j)=2.0*pai 
end if 
end if 


C c computed° here^ and “ 

C value of the objective function is not evaluated. 
C Rather H the 6 change" in the old objective function value caused 
C by the perturbation is computed. 


$ 

$ 


$ 

$ 


txn=nint(tempxl(j) /delta) 

txr=cst ( txn , 2 ) *cos (cst ( txn ( 1) ) 
txi=cst (txn, 2) *sin (cst (txn, 1) ) 

xn=nint(X(j) /delta) 

xr=cst ( xn , 2 )*cos( cst ( xn , 1 ) ) 

vi=cst (xn, 2) *sin (cst (xn, 1) ) , . , . . 

nobjo=objo- (dmat ( j ) * (txr** 2 +txi** 2 ) ) + (dmat ( ] ) 
(xr**2+xi**2) ) 

mm=0 

do ii=l , KKK 

nconaifl)=con(ii,l) + (XX(j,mm)*(xr-txr)) 

+ (XX( j ,mm+l) * (xi-txx) ) 
neon ( ii , 2 ) =con(ii, 2) +(XX( j ,mm) * (xi-txi) ) 

+ (XX( j,nun+l)*(txr-xr) ) 

mm=mm+l 
end do 
nobjol=0 . 0 

jj=° 

kk=KKK/2 
do ii=l,KKK-l, 2 

jj=jj +1 

nobjol=nobjol+(k3* ( (ncon( j j , 1) -vail) **2) ) + 
(kl* ( (ncon(kk, 1 ) -val2) **2) ) + .. 

(k2*(ncon(ii,2)**2)) + (k 2 *(ncon(n+l, 2 )** 2 )) 

end do 

FF ( 2 ) =nob jo+nob jol 


c Tf the new objective function value (i.e. due to the 

i Ir.sss.'ss s: 

% counts, 

C 'accept' is incremented. 
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if C FF ( 2 ) . lt.FF(l) )then 
FF ( 1) =FF (2) 
objo=nobjo 
do ii=l , KKK . . 

con ( ii , 1) -neon ( n , 1 ) 
con ( i i , 2 ) =ncon ( i i , 2 ) 


end do 
obj f=FF ( 2 ) 
teinpxl ( j) -X( j) 

accept=accept+l 

go to 701 
end if 


c If the perturbation results 

C function value then, it will y , pr ob' below 
C c ba«f acc^tV/tn rthf objective 
C value 'objf' is updated along with the variables 
C compute it. 


objective 
a certain 
. Again if 
function 
used to 


thi=(FF(2) -FF(1) ) /temp 
if (thi .ge. 80. 0) then 
thi=80 . 0 

elseif (thi. le. 0.000001) then 

thi=0 . 0 

end if . v . 

prob=1.0/ ( 1 . 0+exp(thi) ) 
randnum2=ran (bsed) 
i f ( r andnum2 . 1 t . prob) then 
FF (1) =FF (2 ) 
objo=nobjo 
do ii=l,KKK _ 

con ( i i , 1 ) —neon ( i i « 1 ) 
con ( i i , 2 ) =ncon ( i i , 2 ) 
end do 
objf=FF (2) 
tempxl ( j)=X( j) 

accept=accept+l 

go to 701 
end if 


C If the perturbation is not accepted then the filter pixel 
c value is restored to its previous value. 


701 


end 


X ( j ) =tempxl ( j ) 

if (objf.lt. minobjf) . 

rec (L, X,minX, ob;j f , minob]f) 

do 


write (25, *) i,objf 
write ( 26 , * ) i , objo 
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c 

c 

c 

c 

c 


**** Updating the Temperature parameter 

If the no. of accepted perturbations >= 10xL 
temperature parameter 'temp', and proceed, 
counter ' attempt', 'accept . 


************ 

then update the 
Initialize the 


if (accept .ge. 10*L) then 

temp=( (0.98) **i) *temp0 

accept=0 

pp=0 

attempt=0 
end if 


C If the no. of attempted perturbations (without acceptance) 
C is >= lOOxL then update the temperature parameter and make 
C a note of this fact by incrementing the counter 
C 'attempt' . 


if (pp.ge. 100*L) then 

temp= ( (0.98) **i) *temp0 
accept=0 

pp=° 

attempt=attempt+l 
end if 


C If the above has occurred thrice continuously, then 
C terminate the optimization. This is the convergence test. I 
C so then branch to 200. 


i f ( attempt . ge . 3 ) then 
attempt=0 
accept=0 
go to 200 
end if 


if (temp. le. (1.0E-04) )then 
attempt=0 
accept=0 
go to 200 
end if 


779 end do 


C 

C 

C 


f the convergence criterion is not met after iter 
derations , then quit the program. ( This so that the 
irogram does not get into an endless loop) . 


write (devl , *) ' 
write (devl , *) ' 


9 
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200 


write (devl , *) ' 
write (devl , * ) ' 
write (devl , *) ' 
write (devl , *) ' 
go to 300 
write (devl , *) 
write (devl , *) ' 
write (devl , *) ' 


ERROR ERROR ERROR 

**************************** 


9 

No convergence after 


',i,' iterations' 


***************************** ' 
Converged after ',i,' iterations' 


n in fhe arrav 'minX' (of dimension L) . If the final vaiue oi 
C tie objective function (at the end of ^ optimization) is 
C not the least then the least value is taken. 


300 if (objf .gt.minobjf ) then 

do zz=l,L 

X(zz) =minX(zz) 
end do 

callcomputef n (NN , L, KKK, XX, X,dmat , cst , kl , k2 , k3 , delta , 
$ vail, val2,objo, objf , con) 

write (devl ,*) ' ' . 

write (devl,*) ' The temp is', temp 
write (devl , *) ' ' 


C The optimization is repeated with 
C constraints penalty violation constants Kl 


values 
. ' K2 ' 


of the 
, ' K3 ' . 


if (oncem.ne. 20) then 
kl=kl+6.0 
k2=k2+12 . 0 
k3=k3+3 . 0 

write (27 , * ) oncem , ob j f 
write (28 ,*) oncem, ob jo 
go to 420 
end if 


C Usinq the phase values of the filter pixels from the array 
c 'X' Dick out their corresponding magnitude values and 
C coVte th°e U complex filte/pixel values store these complex 
C filter pixel values in the array flit . 
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500 do i=l,L 

N0=nint(X(i) /delta) 
rlf il=cst (NO , 2) *cos (cst (NO, 1) ) 
imf il=cst(N0, 2) *sin(cst(N0, 1) ) 
filt(i)=cmplx(rlfil, iinfil) 
end do 


C Arrange the filter from a vector form into a matrix form 

jj*0 

do i=l , N 
do j=l , N 

filtl(i, j)=filt(33) 
end do 
end do 


C 


Save 


the final filter 


in a file for future correlations. 


$ 


f ilename3=' f iltthesis. s64 ' 
open (unit=14 , f ile=f ilename3 , form= 
, status= • unknown ' ) 
write(14) f iltl 
close(unit=14) 


'unformatted' 


C 

c 


Write the final value of the objective function and 
constraints. 


write(devl,*) 'Total Objective fn. value is',objf 
write (devl , *) 'The Correlation Ene rgy ( is',ob]o 
write (devl, *) 'Constants kl,k2,k3 are ,kl,k2,k3, 
write(devl, *) 'The Constraints (real,imag) are: 
do i=l , KKK 

write (devl , * ) con ( i , 1 ) t con ( l , 2 ) 
end do 


stop 

end 
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subroutine rec ( L , X , minX , ob j f , mi nob j f ) 


c ************************************************************ 

C (input) L == Dimension of the array X defined in the main 
C program above. 

C (input) X == Array of dimension L containing the current 
C phase values of the filter pixels. 

C (input) objf == Contains the value of the objective function 
C evaluated from the array X. 

C (output) minx == Array of dimension L. The values of X are 
C stored into 'minX' 

C (output) minobjf == The value from 'objf' is stored into 
C 'minobjf' 

C************************************************************* 
real X(L) ,minX(L) , objf , minobjf 


do i=l,L 

minX(i)=X(i) 
end do 

minobjf=objf 


return 

end 


subroutine computef n (NN , L, KKK , XX , X , dmat , cst , kl , k2 , k3 , 
$ delta, vail, val 2 ,objo, objf ,con) 


C ************************************************************ 

C A routine to calculate the value of the objective function, 
C the value of the correlation energy plane, and value of the 
C constraints. XX is a 2 dimensional array containing the real 
C part of the elements of the reference image in the first 
C column and the imaginary parts of the elements in the second 
C column. X is a one dimensional array. The elements of this 
C array correspond to the phase values of the filter pixels. 


C 

C 

C NN 
C 

C L 


( input) 
( input) 



o o 
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C 

C 

C 

C 

C 

C 

C 

C 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 


YY ( innut array) == Each of the columns correspond to the 
rem and imaginary part of the fourrer transformed 

images . 

X (input array) == Contains the phase values of the filter 
pixels. 

cst (input array) == Contains the SLM constraint table. 

Ki, K2, K3 (input) == as defined in the main program. 

delta (input) == as defined in the main program. 

vail, val2 (input) == as defined in the main program. 

objo.objf (output) « correlation plane energy value, and 
the objective function value respectively. 

con (output array) == Correlation plane constraints. 

************************************************************ 

integer NN # L # KKK,num, i, j , j j 
real XX(L,20) , X (L) , cst (4096 , 2) 

real objo,objf ,objol,delta,con(KKK,2) ,dmat(L) 
real rlf . imf , ave, vail , val2 


objo=0 . 0 
objol=0 . 0 
objf=0. 0 
ave=0 . 0 


do i=l , KKK 

con ( i, 1) =0 . 0 
con ( i , 2 ) =0 . 0 
end do 


do j=l,L 

num=nint (X ( j ) /delta) 
rlf=cst (num, 2) *cos (cst (num, 1) ) 
imf=cst (num, 2) *sin (cst (num, 1) ) 
objo=objo + (dmat ( j ) * (rlf **2+imf **2) ) 
mm=0 


$ 

$ 


io i=l, KKK 

mm=mm+l 

con ( i , 1) =con (i , 1) + 

( (XX( j ,mm) *rlf)+(XX(},mm+l) *imf ) ) 

con ( i , 2 ) =con ( i , 2 ) + 

( (XX ( j ,mm) *imf ) ~(XX( 3 ,mm+l) *rlf ) ) 

mm=mm+l 


end do 
end do 



116 


objol*0 . 0 
j-0 

j j=KKK/2 
do i*l , KKK-1 , 2 

objol=objol + (k3* ( (con( j , 1) -vail) **2) ) + 

$ (kl* ( (con( j j , 1) -val2) **2) ) + 

$ (k2* (con ( i , 2) **2) ) + (k2* (con(i+l, 2) **2 


end do 

objf=objo + objol 


) 


return 

end 


subroutine get inti (array , arrayname) 


Q ************************************************************ 

C A routine to read an integer N by N array stored in an 
C ' unformatted ' format. 

C 

c 

c arrayname (input) == Name of file containing the array 
C array (output) == Integer array from the file arrayname 

C 

r ********************************** 


A****************** 




common N 

integer*2 array (N,N),N 
character* 14 arrayname 

open(unit=8, file=arrayname,form='unformatted' , 

$ status='old' ) 

print * , ' ' 

print *, 'Reading the file '//arrayname 

read (8) array 

close(unit=8) 

print *, 'File transfer completed.' 
print * , ' ' 

return 

end 
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subrout ine getcmp (array .array name) 


c ...........a..*******- * ********* 

C c * routine to read a complex N by N array stored in an 
C -unformatted' format. 

c • t) =- Name of file containing the array 

C ar«rtoutpiT“ Array from the file arrayname 

U..*‘***********“*******““***‘*“**““““““““““* 

common N 
integer*2 N 
complex array (N,N) 
character*^ arrayname 

open(unit=8 , f ile=arrayname, form=- unformatted- , 

$ status='old' ) 

Pfint ''.-Reading the file -//arrayname 
read (8) array 

close (unit=8) 

print * , ' File transfer completed.' 

Drint * ' 


return 

end 



